Deep learning is a practical and efficient technique that has been used extensively in many domains. Using deep learning technology, deepfakes create fake images of a person that people cannot distinguish from the real one. Recently, many researchers have focused on understanding how deepkakes work and detecting using deep learning approaches. This paper introduces an explainable deepfake framework for images creation and classification. The framework consists of three main parts: the first approach is called Instant ID which is used to create deepfacke images from the original one; the second approach called Xception classifies the real and deepfake images; the third approach called Local Interpretable Model (LIME) provides a method for interpreting the predictions of any machine learning model in a local and interpretable manner. Our study proposes deepfake approach that achieves 100% precision and 100% accuracy for deepfake creation and classification. Furthermore, the results highlight the superior performance of the proposed model in deep fake creation and classification.
References
[1]
Zobaed, S., Rabby, F., Hossain, I., Hossain, E., Hasan, S., et al. (2021) DeepFakes: Detecting Forged and Synthetic Media Content Using Machine Learning. In: Montasari, R. and Jahankhani, H., Eds., Artificial Intelligence in Cyber Security: Impact andImplications, Springer, Berlin, 177-201. https://doi.org/10.1007/978-3-030-88040-8_7
[2]
Lee, H., Park, S., Yoo, J., Jung, S. and Huh, J. (2020) Face Recognition at a Distance for a Stand-Alone Access Control System. Sensors, 20, 785-796. https://doi.org/10.3390/s20030785
[3]
Al Bdairi, A., Xiao, Z., Alkhayyat, A., Humaidi, A., Fadhel, M., Taher, B., Alzubaidi, L., Santamaria, J. and Al-Shamma, O. (2022) Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification. Applied Sciences, 10, 2605-2520. https://doi.org/10.3390/app12052605
[4]
Sarangi, P., Nayak, D., Panda, M. and Majhi, B. (2022) A Feature-Level Fusion Based Improved Multimodal Biometric Recognition System Using Ear and Profile Face. Journal of Ambient Intelligence and Humanized Computing, 13, 1867-1898. https://doi.org/10.1007/s12652-021-02952-0
[5]
Mahmud, M., Kaiser, M.S., Rahman, M.A., Wadhera, T., Brown, D.J., Shopland, N., Burton, A., Hughes-Roberts, T., Mamun, S.A., Ieracitano, C. and Tania, M.H. (2022) Towards Explainable and Privacy-Preserving Artificial Intelligence for Personalisation in Autism Spectrum Disorder. International Conference on Human-Computer Interaction, Gothenburg, Sweden, 26 June-1 July 2022, 356-370. https://doi.org/10.1007/978-3-031-05039-8_26
[6]
Ali, S., Akhlaq, F., Imran, A.S., Kastrati, Z., Daudpota, S.M. and Moosa, M. (2023) The Enlightening Role of Explainable Artificial Intelligence in Medical & Healthcare Domains: A Systematic Literature Review. Computers in Biology and Medicine, 166, Article 107555. https://doi.org/10.1016/j.compbiomed.2023.107555
[7]
Yousfi, Y., Butora, J., Khvedchenya, E. and Fridrich, J. (2020) Imagenet Pre-Trained CNNs for JPEG Steganalysis. Proceedings of the 2020 IEEE International Workshopon Information Forensics and Security (WIFS), New York, 6-11 December 2020, 1-6. https://doi.org/10.1109/WIFS49906.2020.9360897
[8]
Thambawita, V., Isaksen, J., Hicks, S., Ghouse, J., Ahlberg, G., Linneberg, A., Grarup, N., Ellervik, C. and Olesen, M. (2021) Deepfake Electrocardiograms Using Generative Adversarial Networks Are the Beginning of the End for Privacy Medicine. Scientific Reports, 11, 21869-21889. https://doi.org/10.1038/s41598-021-01248-9
[9]
El-Sayed Atlam, K.M., Fuketa, M. and Ich Aoe, J. (2003) Document Similarity Measurement Using Field Association Term. Information Processing and ManagementJournal, 39, 809-824. https://doi.org/10.1016/S0306-4573(03)00019-0
[10]
Farsi, M., Hosahalli, D., Manjunatha, B., Gad, I., Atlam, E.-S., Ahmed, A., et al. (2021) Parallel Genetic Algorithms for Optimizing the SARIMA Model for Better Forecasting of the NCDC Weather Data. Alexandria Engineering Journal, 60, 1299-1316. https://doi.org/10.1016/j.aej.2020.10.052
[11]
Noor, T., Almars, A., Alwateer, M., Almaliki, M., et al. (2022) Sarima: A Seasonal Autoregressive Integrated Moving Average Model for Crime Analysis in Saudi Arabia. Electronics, 11, 3986-3998. https://doi.org/10.3390/electronics11233986
[12]
Jung, T., Kim, S. and Kim, K. (2020) Deepvision: Deepfakes Detection Using Human Eye Blinking Pattern. IEEE Access, 8, 83144-83154. https://doi.org/10.1109/ACCESS.2020.2988660
[13]
Hsu, C., Zhuang, Y. and Lee, C. (2020) Deep Fake Image Detection Based on Pairwise Learning. Applied Sciences, 10, 370-386. https://doi.org/10.3390/app10010370
[14]
Rafique, R., Gantassi, R., Amin, R., Frnda, J., Mustapha, A. and Alshehri, A.H. (2023) Deep Fake Detection and Classification Using Error-Level Analysis and Deep Learning. Scientific Reports, 13, Article No. 7422. https://doi.org/10.1038/s41598-023-34629-3
[15]
Suganthi, S., Ayoobkhan, M.U.A., Bacanin, N., Venkatachalam, K., et al. (2022) Deep Learning Model for Deep Fake Face Recognition and Detection. PeerJ Computer Science, 8, e881. https://doi.org/10.7717/peerj-cs.881
[16]
Silva, S.H., Bethany, M., Votto, A.M., Scarff, I.H., Beebe, N. and Najafirad, P. (2022) Deepfake Forensics Analysis: An Explainable Hierarchical Ensemble of Weakly Supervised Models. Forensic Science International: Synergy, 4, Article ID: 100217. https://doi.org/10.1016/j.fsisyn.2022.100217
[17]
Thabtah, F. (2019) Machine Learning in Autistic Spectrum Disorder Behavioral Research: A Review and Ways Forward. Informatics for Health and Social Care, 44, 278-297. https://doi.org/10.1080/17538157.2017.1399132
[18]
Thabtah, F., Kamalov, F. and Rajab, K. (2018) A New Computational Intelligence Approach to Detect Autistic Features for Autism Screening.International Journal of Medical Informatics, 117, 112-124. https://www.sciencedirect.com/science/article/pii/s1386505618300546 https://doi.org/10.1016/j.ijmedinf.2018.06.009
[19]
Hossain, S., Islam, M.A., Quinn, F., Huq, J.M. and Moni, M. (2019) Machine Learning and Bioinformatics Models to Identify Gene Expression Patterns of Ovarian Cancer Associated with Disease Progression and Mortality. Journal of Biomedical Informatics, 100, 310-313. https://doi.org/10.1016/j.jbi.2019.103313
[20]
Howlader, K., Satu, M., Barua, A. and Moni, M. (2018) Mining Significant Features of Diabetes Mellitus Applying Decision Trees: A Case Study in Bangladesh. https://doi.org/10.1101/481994
[21]
Thabtah, F. (2017) Autism Spectrum Disorder Screening: Machine Learning Adaptation and Dsm-5 Fulfillment. Proceedings of the 1st International Conference on Medical and Health Informatics, Taichung City, 20-22 May 2017, 1-6. https://doi.org/10.1145/3107514.3107515
[22]
Malki, Z., Atlam, E.-S., Hassanien, A.E., Dagnew, G., Elhosseini, M.A. and Gad, I. (2020) Association between Weather Data and COVID-19 Pandemic Predicting Mortality Rate: Machine Learning Approaches. Chaos,Solitons andFractals, 138, Article ID: 110137. https://doi.org/10.1016/j.chaos.2020.110137
[23]
Malki, Z., Atlam, E.-S., Ewis, A., Dagnew, G., Reda, A., Elmarhomy, G., et al. (2020) ARIMA Models for Predicting the End of COVID-19 Pandemic and the Risk of a Second Rebound. Journal of NeuralComputing and Applications, 33, 2929-2948. https://doi.org/10.1007/s00521-020-05434-0
[24]
Malki, Z., Atlam, E.-S., Ewis, A., Dagnew, G., Ghoneim, O.A., Mohamed, A.A., Abdel-Daim, M.M. and Gad, I. (2021) The Covid-19 Pandemic: Prediction Study Based on Machine Learning Model. Journal of Environmental Scienceand Pollution Research, 28, 40496-40506. https://doi.org/10.1007/s11356-021-13824-7
[25]
Almars, A.M., Alwateer, M., Qaraad, M., Amjad, S., Fathi, H., Kelany, A.K., Hussein, N.K. and Elhosseini, M. (2021) Brain Cancer Prediction Based on Novel Interpretable Ensemble Gene Selection Algorithm and Classifier. Diagnostics, 11, Article No. 1936. https://doi.org/10.3390/diagnostics11101936
[26]
Badawy, M., Almars, A.M., Balaha, H.M., Shehata, M., Qaraad, M. and Elhosseini, M. (2023) A Two-Stage Renal Disease Classification Based on Transfer Learning with Hyperparameters Optimization. Frontiers in Medicine, 10, Article ID: 1106717. https://doi.org/10.3389/fmed.2023.1106717
[27]
Alwateer, M., Almars, A.M., Areed, K.N., Elhosseini, M.A., Haikal, A.Y. and Badawy, M. (2021) Ambient Healthcare Approach with Hybrid Whale Optimization Algorithm and Naive Bayes Classifier. Sensors, 21, Article No. 4579. https://doi.org/10.3390/s21134579
[28]
Raj, S. and Masood, S. (2020) Analysis and Detection of Autism Spectrum Disorder Using Machine Learning Techniques. Procedia Computer Science, 167, 994-1004. https://doi.org/10.1016/j.procs.2020.03.399
[29]
Kollias, K.F., Syriopoulou-Delli, C.K., Sarigiannidis, P. and Fragulis, G.F. (2021) The Contribution of Machine Learning and Eye-Tracking Technology in Autism Spectrum Disorder Research: A Review Study. 2021 10th International Conference on Modern Circuits and Systems Technologies (MOCAST). Thessaloniki, 05-07 July 2021, 1-4. https://doi.org/10.1109/MOCAST52088.2021.9493357
[30]
Atlam, E., Ewis, A., Abd El-Raouf, M., Ghoneim, O. and Gad, I. (2022) A New Approach in Identifying the Psychological Impact of Covid-19 on University Student’s Academic Performance. Alexandria Engineering Journal, 61, 5223-5233. https://doi.org/10.1016/j.aej.2021.10.046
[31]
Hooshmand, M.K., Huchaiah, M.D., Alzighaibi, A.R., Hashim, H., Atlam, E.-S. and Gad, I. (2024) Robust Network Anomaly Detection Using Ensemble Learning Approach and Explainable Artificial Intelligence (Xai). Alexandria EngineeringJournal, 94, 120-130. https://doi.org/10.1016/j.aej.2024.03.041
[32]
Masud, M., Almars, A.M., Rokaya, M.B., Meshref, H., Gad, I. and Atlam, E.-S. (2024) A Novel Light-Weight Convolutional Neural Network Model to Predict Alzheimer’s Disease Applying Weighted Loss Function. Journal of DisabilityResearch, 3, Article ID: 20240042. https://doi.org/10.57197/JDR-2024-0042
[33]
Atlam, E.-S., Masud, M., Rokaya, M., Meshref, H., Gad, I. and Almars, A.M. (2024) Easdm: Explainable Autism Spectrum Disorder Model Based on Deep Learning. Journal of Disability Research, 3, Article ID: 20240003. https://doi.org/10.57197/JDR-2024-0003
[34]
Noor, T.H., Almars, A.M., El-Sayed, A. and Noor, A. (2022) Deep Learning Model for Predicting Consumers’ Interests of IoT Recommendation System. InternationalJournal of Advanced Computer Science and Applications, 13, 161-170. https://doi.org/10.14569/IJACSA.2022.0131022
[35]
Wang, Q., Bai, X., Wang, H., Qin, Z. and Chen, A. (2024) Instantid: Zero-Shot Identity Preserving Generation in Seconds.
[36]
Gad, I. and Hosahalli, D. (2020) A Comparative Study of Prediction and Classification Models on NCDC Weather Data. International Journal of Computers and Applications,44, 414-425. https://doi.org/10.1080/1206212X.2020.1766769
[37]
Raza, A., Munir, K. and Almutairi, M. (2022) A Novel Deep Learning Approach for Deepfake Image Detection. Applied Sciences, 12, Article No. 9820. https://doi.org/10.3390/app12199820
[38]
Lewis, J.K., Toubal, I.E., Chen, H., et al. (2020) Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning. 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington DC, 13-15 October 2020, 1-9.
