Digital image forgery (DIF) is a prevalent issue in the modern age, where malicious actors manipulate images for various purposes, including deception and misinformation. Detecting such forgeries is a critical task for maintaining the integrity of digital content. This thesis explores the use of Modified Error Level Analysis (ELA) in combination with a Convolutional Neural Network (CNN), as well as, Feedforward Neural Network (FNN) model to detect digital image forgeries. Additionally, incorporation of Explainable Artificial Intelligence (XAI) to this research provided insights into the process of decision-making by the models. The study trains and tests the models on the CASIA2 dataset, emphasizing both authentic and forged images. The CNN model is trained and evaluated, and Explainable AI (SHapley Additive exPlanation— SHAP) is incorporated to explain the model’s predictions. Similarly, the FNN model is trained and evaluated, and XAI (SHAP) is incorporated to explain the model’s predictions. The results obtained from the analysis reveals that the proposed approach using CNN model is most effective in detecting image forgeries and provides valuable explanations for decision interpretability.
References
[1]
Farid, H. (2009) Image Forgery Detection: A Survey. IEEE Signal Processing Magazine, 26, 16-25. https://doi.org/10.1109/MSP.2008.931079
[2]
He, J., Dong, X., Yi, Z. and Wang, H. (2020) Deep Learning for Image Forgery Detection: A Survey. IEEE Transactions on Information Forensics and Security, 15, 3261-3285.
[3]
Lundberg, S.M. and Lee, S.-I. (2017) A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 4766-4777.
[4]
Al-Qazzaz, N. and El-Sawi, M. (2022) Digital Image Forgery Detection Using Deep Learning Approaches: A Comprehensive Review. IEEE Access, 10, 46360-46395.
[5]
Huang, H., Huang, W., Zhang, X. and Zhang, Y. (2020) Image Forgery Detection Using Integrated Convolution-LSTM (2D) and Convolution (2D). IEEE Signal Processing Letters, 27, 1561-1565.
[6]
Pan, X., Zhang, X., Lyu, S. and Tchoumousset, S. (2010) Image Tampering Detection Using Error Level Analysis and Metadata Analysis. IEEE Transactions on Information Forensics and Security, 5, 492-507.
[7]
Chen, J., Luo, W., Li, X., Li, B. and He, J. (2019) ELA-CNN: A Hybrid Model for Digital Image Forgery Detection. IEEE Transactions on Information Forensics and Security, 14, 150-162.
[8]
Li, Y., Li, X. and Li, B. (2020) Comprehensive Study on Image Forgery Techniques Using Deep Learning. IEEE Transactions on Information Forensics and Security, 15, 3261-3285.
[9]
Ribeiro, M.T., Singh, S. and Guestrin, C. (2016) Why Should I Trust You?: Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 13-17 August 2016, 1135-1144. https://doi.org/10.1145/2939672.2939778
[10]
Huang, H., Huang, W., Tan, T. and Li, J. (2017) A Novel Passive Image Forgery Detection Algorithm Based on Block-Level Error Level Analysis. IEEE Transactions on Information Forensics and Security, 13, 60-74.
[11]
He, K., Xiangyu, Z., Shaoqing, R. and Jian, S. (2016) Deep Residual Learning for Im-Age Recognition. Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778. https://doi.org/10.1109/CVPR.2016.90
[12]
Simonyan, K. and Zisserman, A. (2014) Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of2014 IEEE International Conference on System Engineering and Technology, Bandung, 24-25 November 2014, 354-355.
[13]
Dong, J., Wand, W. and Tan, T. (2013) CASIA Image Tampering Detection Evaluation Database. 2013IEEE China Summit and International Conference on Signal and Information Processing, Beijing, 6-10 July 2013, 422-426. https://doi.org/10.1109/ChinaSIP.2013.6625374
[14]
Jain, A.K. (2010) Data Clustering: 50 Years beyond K-Means. Pattern Recognition Letters, 31, 651-666. https://doi.org/10.1016/j.patrec.2009.09.011
[15]
Witten, I.H., Frank, E. and Hall, M.A. (2011) Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann.
[16]
Mahalanobis, P.C. (1936) On the Generalised Distance in Statistics. Proceedings of the National Academy of Sciences of India, 2, 49-55.
[17]
Krawetz, N. (2016) Error Level Analysis (ELA) for Image Forensics. Digital Forensics Investigation, 19, 16-28.
[18]
Li, Y., Li, X. and Li, B. (2021) Explainable Image Forgery Detection Using SHAP. Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, 19-22 September 2021, 1401-1405.
[19]
Gonzalez, R.C. and Woods, R.E. (2018) Digital Image Processing. 4th Edition, Pearson Education.
[20]
LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. (1998) Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, 86, 2278-2324. https://doi.org/10.1109/5.726791
[21]
Guo, Y., Liu, Y., Krizhevsky, A. and Fei-Fei, L. (2019) Understanding Convolutional Neural Networks with a Mathematical Model. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49, 506-520.
[22]
Sharma, P. (2023) Basic Introduction to Convolutional Neural Network in Deep Learning. https://www.analyticsvidhya.com/blog/2022/03/basic-introduction-to-convolutional-neural-network-in-deep-learning/
[23]
Rosebrock, A. (2023) Convolutional Neural Networks (CNNs) and Layer Types. https://pyimagesearch.com/2021/05/14/convolutional-neural-networks-cnns-and-layer-types/
[24]
GeeksforGeeks (2023) CNN: Introduction to Pooling Layer. https://www.geeksforgeeks.org/cnn-introduction-to-pooling-layer/
[25]
Amidi, A. and Amidi, S. (2023) CS 230-Convolutional Neural Networks Cheat-Sheet. https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-convolutional-neural-networks
[26]
Goodfellow, I., Bengio, Y. and Courville, A. (2016) Deep Learning. MIT Press.
[27]
Hagan, M.T. and Menhaj, M.B. (1994) Training Feedforward Networks with the Marquardt Algorithm. IEEE Transactions on Neural Networks, 5, 989-993. https://doi.org/10.1109/72.329697
[28]
Turing (2023) Understanding Feed Forward Neural Networks with Maths and Statistics. https://www.turing.com/kb/mathematical-formulation-of-feed-forward-neural-network
[29]
Shivkumar, D. (2023) Introduction to Feed Forward Neural Network. https://www.scaler.com/topics/deep-learning/introduction-to-feed-forward-neural-network/
