The rapid growth of technology impacts all aspects of modern life, including banking and financial transactions. While these industries benefit significantly from technological advancements, they also face challenges such as credit card fraud, the most prevalent type of financial fraud. Each year, such fraud leads to billions of dollars in losses for banks, financial institutions, and customers. Although many machine learning (ML) and, more recently, deep learning (DL) solutions have been developed to address this issue, most fail to strike an effective balance between speed and performance. Moreover, the reluctance of financial institutions to disclose their fraud datasets due to reputational risks adds further challenges. This study proposes a predictive model for credit card fraud detection that leverages the unique strengths of Energy-based Restricted Boltzmann Machines (EB-RBM) and Extended Long Short-Term Memory (xLSTM) models. EB-RBM is utilized for its ability to detect new and previously unseen fraudulent patterns, while xLSTM focuses on identifying known fraud types. These models are integrated using an ensemble approach to combine their strengths, achieving a balanced and reliable prediction system. The ensemble employs a bootstrap max-voting mechanism, assigning equal voting rights to EB-RBM and xLSTM, followed by result normalization and aggregation to classify transactions as fraudulent or genuine. The model’s performance is evaluated using metrics such as AUC-ROC, AUC-PR, precision, recall, F1-score, confusion matrix, and elapsed time. Experimental results on a real-world European cardholder dataset demonstrate that the proposed approach effectively balances speed and performance, outperforming recent models in the field.
References
[1]
Federal Bureau of Investigation IC3 Annual Report (2023) Internet Crime Report 2023. https://www.ic3.gov/Media/PDF/AnnualReport/2023_IC3Report.pdf
[2]
Cherif, A., Badhib, A., Ammar, H., Alshehri, S., Kalkatawi, M. and Imine, A. (2023) Credit Card Fraud Detection in the Era of Disruptive Technologies: A Systematic Review. Journal of King Saud University—Computer and Information Sciences, 35, 145-174. https://doi.org/10.1016/j.jksuci.2022.11.008
[3]
Shahana, T., Lavanya, V. and Bhat, A.R. (2023) State of the Art in Financial Statement Fraud Detection: A Systematic Review. Technological Forecasting and Social Change, 192, Article ID: 122527. https://doi.org/10.1016/j.techfore.2023.122527
[4]
Mehndiratta, S. and Gupta, K. (2019) Credit Card Fraud Detection Techniques: A Review. International Journal of Computer Science and Mobile Computing, 8, 43-49.
[5]
Afriyie, J.K., Tawiah, K., Pels, W.A., Addai-Henne, S., Dwamena, H.A., Owiredu, E.O., et al. (2023) A Supervised Machine Learning Algorithm for Detecting and Predicting Fraud in Credit Card Transactions. Decision Analytics Journal, 6, Article ID: 100163. https://doi.org/10.1016/j.dajour.2023.100163
[6]
Mittal, S. and Tyagi, S. (2019) Performance Evaluation of Machine Learning Algorithms for Credit Card Fraud Detection. 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Noida, 10-11 January 2019, 320-324. https://doi.org/10.1109/confluence.2019.8776925
[7]
Carcillo, F., Le Borgne, Y., Caelen, O., Kessaci, Y., Oblé, F. and Bontempi, G. (2021) Combining Unsupervised and Supervised Learning in Credit Card Fraud Detection. Information Sciences, 557, 317-331. https://doi.org/10.1016/j.ins.2019.05.042
[8]
Femila Roseline, J., Naidu, G., Samuthira Pandi, V., Alamelu alias Rajasree, S. and Mageswari, D.N. (2022) Autonomous Credit Card Fraud Detection Using Machine Learning Approach. Computers and Electrical Engineering, 102, Article ID: 108132. https://doi.org/10.1016/j.compeleceng.2022.108132
[9]
Reshma, R.S. (2018) Deep Learning Enabled Fraud Detection in Credit Card Transactions. International Journal of Research and Scientific Innovation (IJRSI), V, 111-115.
[10]
Alarfaj, F.K., Malik, I., Khan, H.U., Almusallam, N., Ramzan, M. and Ahmed, M. (2022) Credit Card Fraud Detection Using State-of-the-Art Machine Learning and Deep Learning Algorithms. IEEE Access, 10, 39700-39715. https://doi.org/10.1109/access.2022.3166891
[11]
Patil, S., Nemade, V. and Soni, P.K. (2018) Predictive Modelling for Credit Card Fraud Detection Using Data Analytics. Procedia Computer Science, 132, 385-395. https://doi.org/10.1016/j.procs.2018.05.199
[12]
Carneiro, N., Figueira, G. and Costa, M. (2017) A Data Mining Based System for Credit-Card Fraud Detection in E-Tail. Decision Support Systems, 95, 91-101. https://doi.org/10.1016/j.dss.2017.01.002
[13]
Rtayli, N. and Enneya, N. (2020) Enhanced Credit Card Fraud Detection Based on SVM-Recursive Feature Elimination and Hyper-Parameters Optimization. Journal of Information Security and Applications, 55, Article ID: 102596. https://doi.org/10.1016/j.jisa.2020.102596
[14]
Van Belle, R., Baesens, B. and De Weerdt, J. (2023) Catchm: A Novel Network-Based Credit Card Fraud Detection Method Using Node Representation Learning. Decision Support Systems, 164, Article ID: 113866. https://doi.org/10.1016/j.dss.2022.113866
[15]
Makki, S. (2019) An Efficient Classification Model for Analyzing Skewed Data to Detect Frauds in the Financial Sector. Master’s Thesis, Université de Lyon.
[16]
Rtayli, N. and Enneya, N. (2020) Selection Features and Support Vector Machine for Credit Card Risk Identification. Procedia Manufacturing, 46, 941-948. https://doi.org/10.1016/j.promfg.2020.05.012
[17]
Gupta, P., Varshney, A., Khan, M.R., Ahmed, R., Shuaib, M. and Alam, S. (2023) Unbalanced Credit Card Fraud Detection Data: A Machine Learning-Oriented Comparative Study of Balancing Techniques. Procedia Computer Science, 218, 2575-2584. https://doi.org/10.1016/j.procs.2023.01.231
[18]
Wu, B., Lv, X., Alghamdi, A., Abosaq, H. and Alrizq, M. (2023) Advancement of Management Information System for Discovering Fraud in Master Card Based Intelligent Supervised Machine Learning and Deep Learning during SARS-CoV2. Information Processing & Management, 60, Article ID: 103231. https://doi.org/10.1016/j.ipm.2022.103231
[19]
Somasundaram, A. and Reddy, S. (2018) Parallel and Incremental Credit Card Fraud Detection Model to Handle Concept Drift and Data Imbalance. Neural Computing and Applications, 31, 3-14. https://doi.org/10.1007/s00521-018-3633-8
[20]
Quah, J.T.S. and Sriganesh, M. (2008) Real-Time Credit Card Fraud Detection Using Computational Intelligence. Expert Systems with Applications, 35, 1721-1732. https://doi.org/10.1016/j.eswa.2007.08.093
[21]
de Sá, A.G.C., Pereira, A.C.M. and Pappa, G.L. (2018) A Customized Classification Algorithm for Credit Card Fraud Detection. Engineering Applications of Artificial Intelligence, 72, 21-29. https://doi.org/10.1016/j.engappai.2018.03.011
[22]
Zakaryazad, A. and Duman, E. (2016) A Profit-Driven Artificial Neural Network (ANN) with Applications to Fraud Detection and Direct Marketing. Neurocomputing, 175, 121-131. https://doi.org/10.1016/j.neucom.2015.10.042
[23]
Sahin, Y., Bulkan, S. and Duman, E. (2013) A Cost-Sensitive Decision Tree Approach for Fraud Detection. Expert Systems with Applications, 40, 5916-5923. https://doi.org/10.1016/j.eswa.2013.05.021
[24]
Dornadula, V.N. and Geetha, S. (2019) Credit Card Fraud Detection Using Machine Learning Algorithms. Procedia Computer Science, 165, 631-641. https://doi.org/10.1016/j.procs.2020.01.057
[25]
Hilal, W., Gadsden, S.A. and Yawney, J. (2022) Financial Fraud: A Review of Anomaly Detection Techniques and Recent Advances. Expert Systems with Applications, 193, Article ID: 116429. https://doi.org/10.1016/j.eswa.2021.116429
[26]
Bagchi, D., Mukherjee, A. and Pal, S. (2021) A One Step Further Approach to Fraud Detection. Journal of Computer Science and Engineering (JCSE), 2, 112-119.
[27]
Carta, S., Fenu, G., Reforgiato Recupero, D. and Saia, R. (2019) Fraud Detection for E-Commerce Transactions by Employing a Prudential Multiple Consensus Model. Journal of Information Security and Applications, 46, 13-22. https://doi.org/10.1016/j.jisa.2019.02.007
[28]
Misra, S., Thakur, S., Ghosh, M. and Saha, S.K. (2020) An Autoencoder Based Model for Detecting Fraudulent Credit Card Transaction. Procedia Computer Science, 167, 254-262. https://doi.org/10.1016/j.procs.2020.03.219
[29]
Nguyen, N., Duong, T., Chau, T., Nguyen, V., Trinh, T., Tran, D., et al. (2022) A Proposed Model for Card Fraud Detection Based on CatBoost and Deep Neural Network. IEEE Access, 10, 96852-96861. https://doi.org/10.1109/access.2022.3205416
[30]
Lei, Y., Ma, C., Ren, Y., Chen, X., Narayan, S. and Huynh, A.N.Q. (2023) A Distributed Deep Neural Network Model for Credit Card Fraud Detection. Finance Research Letters, 58, Article ID: 104547. https://doi.org/10.1016/j.frl.2023.104547
[31]
Forough, J. and Momtazi, S. (2021) Ensemble of Deep Sequential Models for Credit Card Fraud Detection. Applied Soft Computing, 99, Article ID: 106883. https://doi.org/10.1016/j.asoc.2020.106883
[32]
Zhang, X., Han, Y., Xu, W. and Wang, Q. (2021) HOBA: A Novel Feature Engineering Methodology for Credit Card Fraud Detection with a Deep Learning Architecture. Information Sciences, 557, 302-316. https://doi.org/10.1016/j.ins.2019.05.023
[33]
Mubalaike, A.M. and Adali, E. (2018) Deep Learning Approach for Intelligent Financial Fraud Detection System. 2018 3rd International Conference on Computer Science and Engineering (UBMK), Sarajevo, 20-23 September 2018, 598-603. https://doi.org/10.1109/ubmk.2018.8566574
[34]
Pumsirirat, A. and Yan, L. (2018) Credit Card Fraud Detection Using Deep Learning Based on Auto-Encoder and Restricted Boltzmann Machine. International Journal of Advanced Computer Science and Applications, 9. https://doi.org/10.14569/ijacsa.2018.090103
[35]
Raghavan, P. and Gayar, N.E. (2019) Fraud Detection Using Machine Learning and Deep Learning. 2019 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dubai, 11-12 December 2019, 334-339. https://doi.org/10.1109/iccike47802.2019.9004231
[36]
Abakarim, Y., Lahby, M. and Attioui, A. (2018) An Efficient Real Time Model for Credit Card Fraud Detection Based on Deep Learning. Proceedings of the 12th International Conference on Intelligent Systems: Theories and Applications, Rabat, 24-25 October 2018, 1-7. https://doi.org/10.1145/3289402.3289530
[37]
Aftabi, S.Z., Ahmadi, A. and Farzi, S. (2023) Fraud Detection in Financial Statements Using Data Mining and GAN Models. Expert Systems with Applications, 227, Article ID: 120144. https://doi.org/10.1016/j.eswa.2023.120144
[38]
Karthikeyan, T., Govindarajan, M. and Vijayakumar, V. (2023) An Effective Fraud Detection Using Competitive Swarm Optimization Based Deep Neural Network. Measurement: Sensors, 27, Article ID: 100793. https://doi.org/10.1016/j.measen.2023.100793
[39]
Xu, A., Tian, M., Firouzi, B., Alattas, K.A., Mohammadzadeh, A. and Ghaderpour, E. (2022) A New Deep Learning Restricted Boltzmann Machine for Energy Consumption Forecasting. Sustainability, 14, Article 10081. https://doi.org/10.3390/su141610081
[40]
Roder, M., de Rosa, G.H., de Albuquerque, V.H.C., Rossi, A.L.D. and Papa, J.P. (2022) Energy-Based Dropout in Restricted Boltzmann Machines: Why Not Go Random. IEEE Transactions on Emerging Topics in Computational Intelligence, 6, 276-286. https://doi.org/10.1109/tetci.2020.3043764
[41]
Decelle, A., Furtlehner, C., Navas Gómez, A.D.J. and Seoane, B. (2024) Inferring Effective Couplings with Restricted Boltzmann Machines. SciPost Physics, 16, Article 95. https://doi.org/10.21468/scipostphys.16.4.095
[42]
Elfwing, S., Uchibe, E. and Doya, K. (2015) Expected Energy-Based Restricted Boltzmann Machine for Classification. Neural Networks, 64, 29-38. https://doi.org/10.1016/j.neunet.2014.09.006
Beck, M., Pöppel, K., Spanring, M., Auer, A., Prudnikova, O., Kopp, M., Hochreiter, S., et al. (2024) xLSTM: Extended Long Short-Term Memory. arXiv: 2405.04517. https://doi.org/10.48550/arXiv.2405.04517
[45]
Mittal, A. (2024) xLSTM: A Comprehensive Guide to Extended Long Short Term Memory. Unite.AI. https://www.unite.ai/xlstm-a-comprehensive-guide-to-extended-long-short-term-memory/
[46]
Alhamid, M. (2025) Ensemble Models: What Are They and When Should You Use Them. Builtin. https://builtin.com/machine-learning/ensemble-model
[47]
Fanai, H. and Abbasimehr, H. (2023) A Novel Combined Approach Based on Deep Autoencoder and Deep Classifiers for Credit Card Fraud Detection. Expert Systems with Applications, 217, Article ID: 119562. https://doi.org/10.1016/j.eswa.2023.119562
[48]
Runchi, Z., Liguo, X. and Qin, W. (2023) An Ensemble Credit Scoring Model Based on Logistic Regression with Heterogeneous Balancing and Weighting Effects. Expert Systems with Applications, 212, Article ID: 118732. https://doi.org/10.1016/j.eswa.2022.118732
[49]
Bagga, S., Goyal, A., Gupta, N. and Goyal, A. (2020) Credit Card Fraud Detection Using Pipeling and Ensemble Learning. Procedia Computer Science, 173, 104-112. https://doi.org/10.1016/j.procs.2020.06.014
[50]
Xu, B., Wang, Y., Liao, X. and Wang, K. (2023) Efficient Fraud Detection Using Deep Boosting Decision Trees. Decision Support Systems, 175, Article ID: 114037. https://doi.org/10.1016/j.dss.2023.114037