The rapidly evolving field of explainable Artificial Intelligence (XAI) offers new avenues in forensic psychiatry, addressing critical needs for transparency and reliability in decision-making processes. This paper explores the integration of XAI within forensic psychiatry, with a focus on enhancing decision support systems in complex assessments of human behavior and cognition. Key research objectives include evaluating the potential of XAI techniques to clarify decision pathways and improve interpretability in psychiatric evaluations, particularly within judicial settings where precision and accountability are paramount. The study employs a comprehensive methodology that synthesizes digital forensics and AI techniques to develop a framework that emphasizes clarity and insight into forensic psychiatric evaluations. By leveraging feature selection algorithms, decision trees, and Bayesian networks, the study enhances the interpretability and robustness of forensic assessments, addressing challenges of data complexity and variable transparency. Additionally, the paper presents a case study on drug testing in forensic psychiatry, showcasing how XAI can discern critical patterns within vast datasets, contributing to a nuanced understanding of psychiatric profiles. Results indicate that XAI methodologies significantly improve interpretability in forensic psychiatry, revealing previously obscured data relationships and enabling more precise, evidence-based conclusions. The paper concludes by discussing the opportunities and limitations of XAI, such as balancing transparency with predictive power, and the ethical considerations required for its responsible deployment in forensic settings. This study underscores the role of XAI in transforming forensic psychiatric practices, laying a foundation for future advancements aimed at refining assessment reliability and fostering fairer judicial outcomes.
Cite this paper
Filippis, R. D. and Foysal, A. A. (2024). Integrating Explainable Artificial Intelligence (XAI) in Forensic Psychiatry: Opportunities and Challenges. Open Access Library Journal, 11, e2518. doi: http://dx.doi.org/10.4236/oalib.1112518.
Heilbrun, K., Grisso, T. and Goldstein, A. (2008) Foundations of Forensic Mental Health Assessment. Oxford University Press. https://doi.org/10.1093/med/9780195323092.001.0001
Maynard-Moody, S. and Musheno, M. (2022) Cops, Teachers, Counselors: Stories from the Front Lines of Public Service. University of Michigan Press. https://doi.org/10.3998/mpub.12247078
Santosh, K.C. and Gaur, L. (2022) Artificial Intelligence and Machine Learning in Public Healthcare: Op-portunities and Societal Impact. Springer Nature. https://doi.org/10.1007/978-981-16-6768-8
Li, X., Cao, C.C., Shi, Y., Bai, W., Gao, H., Qiu, L., et al. (2020) A Survey of Data-Driven and Knowledge-Aware Explainable AI. IEEE Transactions on Knowledge and Data Engineering, 34, 29-49. https://doi.org/10.1109/tkde.2020.2983930
Holt, T.J., Bossler, A.M. and Seigfried-Spellar, K.C. (2022) Cybercrime and Digital Forensics: An Introduc-tion. Routledge. https://doi.org/10.4324/9780429343223
Padhi, A., Agarwal, A., Saxena, S.K. and Katoch, C.D.S. (2023) Transforming Clinical Vi-rology with AI, Machine Learning and Deep Learning: A Comprehensive Review and Outlook. VirusDisease, 34, 345-355. https://doi.org/10.1007/s13337-023-00841-y
Podgorelec, V., Kokol, P., Stiglic, B. and Rozman, I. (2002) Decision Trees: An Overview and Their Use in Medicine. Journal of Medical Systems, 26, 445-463. https://doi.org/10.1023/a:1016409317640
Joseph, R. (2023) The Importance of Psychology in Law and Investigation: Exploring Forensic Psychological Investigative Techniques and Criminal Psychology. In: Shekhar, B. and Pokhariyal, P., Eds., Forensic Jus-tice, Routledge, 312-330. https://doi.org/10.4324/9781032629346-21
Sharifani, K. and Amini, M. (2023) Machine Learning and Deep Learning: A Review of Methods and Ap-plications. World Information Technology and Engineering Journal, 10, 3897-3904.
James, H. (2005) Criminal Responsibility, Abnormal Mental States, and the Functions of Expert Medico-Psychological Evidence. Ph.D. Dis-sertation, University of Nottingham.
Du, X., Hargreaves, C., Sheppard, J., Anda, F., Sayakkara, A., Le-Khac, N., et al. (2020). SoK. Proceedings of the 15th International Conference on Availability, Reliability and Security, New York, 25-28 August 2020, 1-10. https://doi.org/10.1145/3407023.3407068
Lefèvre, T. and Tournois, L. (2023) Artificial Intelligence and Diagnostics in Medicine and Forensic Science. Diagnostics, 13, Article 3554. https://doi.org/10.3390/diagnostics13233554
Wang, Y. and Chung, S.H. (2021) Artificial Intelligence in Safety-Critical Systems: A Systematic Review. Industrial Management & Data Systems, 122, 442-470. https://doi.org/10.1108/imds-07-2021-0419
Fiorino, C., Jeraj, R., Clark, C.H., Garibaldi, C., Georg, D., Muren, L., et al. (2020) Grand Challenges for Medical Physics in Radiation Oncology. Radiotherapy and Oncology, 153, 7-14. https://doi.org/10.1016/j.radonc.2020.10.001
Ratkalkar, M., Jackson, C. and Heilbrun, K. (2023) Race-Informed Forensic Mental Health Assessment: A Principles-Based Analysis. International Journal of Forensic Mental Health, 22, 314-325. https://doi.org/10.1080/14999013.2023.2178556
Neal, T.M.S. and Grisso, T. (2014) Assessment Practices and Expert Judgment Methods in Fo-rensic Psychology and Psychiatry: An International Snapshot. Criminal Justice and Behavior, 41, 1406-1421. https://doi.org/10.1177/0093854814548449
Alam, S. and Altiparmak, Z. (2024) XAI-CF—Examining the Role of Explainable Artificial Intelligence in Cyber Forensics. arXiv: 2402.02452. https://doi.org/10.48550/arXiv.2402.02452
Anguera, M.T., Portell, M., Chacón-Moscoso, S. and Sanduvete-Chaves, S. (2018) Indirect Observation in Everyday Contexts: Concepts and Methodological Guidelines within a Mixed Methods Framework. Frontiers in Psychology, 9, Article 13. https://doi.org/10.3389/fpsyg.2018.00013
Mali, N., Karpe, M. and Ka-dam, V. (2011) A Review on Biological Matrices and Analytical Methods Used for Determination of Drug of Abuse. Journal of Applied Pharmaceutical Science, 1, 58-65.
Marchei, E., Ferri, M.A., Torrens, M., Farré, M., Pacifici, R., Pichini, S., et al. (2021) Ultra-High Performance Liquid Chromatography-High Resolution Mass Spectrometry and High-Sensitivity Gas Chromatography-Mass Spectrometry Screening of Classic Drugs and New Psychoactive Substances and Metabolites in Urine of Consumers. International Journal of Molecular Sciences, 22, Article 4000. https://doi.org/10.3390/ijms22084000
Nuthakki, S., Uttiramerur, A.D., Nuthakki, Y. and Munjala, M.B. (2024) Navigating the Medi-cal Landscape: A Review of Chatbots for Biomarker Extraction from Diverse Medical Reports. International Journal for Multidisciplinary Research, 6, 1-16. https://doi.org/10.36948/ijfmr.2024.v06i01.13154
Heilbrun, K., DeMatteo, D., Marczyk, G. and Goldstein, A.M. (2008) Standards of Practice and Care in Forensic Mental Health Assessment: Legal, Professional, and Princi-ples-Based Consideration. Psychology, Public Policy, and Law, 14, 1-26. https://doi.org/10.1037/1076-8971.14.1.1
Owen, C., Tarantello, C., Jones, M. and Tennant, C. (1998) Violence and Aggression in Psychiatric Units. Psychiatric Services, 49, 1452-1457. https://doi.org/10.1176/ps.49.11.1452
Levenson, J. and Grady, M. (2016) Childhood Adversity, Substance Abuse, and Violence: Implications for Trau-ma-Informed Social Work Practice. Journal of Social Work Practice in the Addic-tions, 16, 24-45. https://doi.org/10.1080/1533256x.2016.1150853
Zipursky, J., Gomes, T., Everett, K., Calzavara, A., Paterson, M., Austin, P.C., et al. (2023) 2023 ACMT Annual Scientific Meeting Abstracts—San Diego, CA. Journal of Medical Toxicology, 19, 63-168. https://doi.org/10.1007/s13181-023-00930-w
Laidler, K.A.J., Loh, C., Chong, S., Lum, L.G., Ma, N., Sze, B. and Cheung, J. (2000) The Hong Kong Drug Market. A Report for UNICRI on The UNDCP Global Study in Illicit Drug Markets. Centre for Criminology, University of Hong Kong, 6-8.
Hanzlick, R. and Goodin, J. (1997) Mind Your Manners: Part III: Individual Scenario Results and Discussion of the National Association of Medical Examiners Manner of Death Questionnaire, 1995. The American Journal of Forensic Medicine and Patholo-gy, 18, 228-245. https://doi.org/10.1097/00000433-199709000-00003
Grunwald, S. (2021) Grand Challenges in Pedometrics—AI Research. Frontiers in Soil Sci-ence, 1, Article 714323. https://doi.org/10.3389/fsoil.2021.714323
Hsiao, J.I.H. (2021) Back to the Future: The Reviving of the Mental Steps Doctrine and the Immature Demise of Artificial Intelligence? Journal of Science and Technology, 31, 179-225.
Costello, E.J., Egger, H. and Angold, A. (2005) 10-Year Research Update Review: The Epidemiology of Child and Adolescent Psychiatric Disorders: I. Methods and Public Health Bur-den. Journal of the American Academy of Child & Adolescent Psychiatry, 44, 972-986. https://doi.org/10.1097/01.chi.0000172552.41596.6f
Saeed, W. and Omlin, C. (2023) Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities. Knowledge-Based Systems, 263, Article 110273. https://doi.org/10.1016/j.knosys.2023.110273
Delanerolle, G., Yang, X., Shetty, S., Raymont, V., Shetty, A., Phiri, P., et al. (2021) Artificial Intelligence: A Rapid Case for Advancement in the Personalization of Gynaecology/Obstetric and Mental Health Care. Women’s Health, 17. https://doi.org/10.1177/17455065211018111
Casino, F., Dasaklis, T.K., Spathoulas, G.P., Anagnostopoulos, M., Ghosal, A., Borocz, I., et al. (2022) Re-search Trends, Challenges, and Emerging Topics in Digital Forensics: A Review of Reviews. IEEE Access, 10, 25464-25493. https://doi.org/10.1109/access.2022.3154059
Thieme, A., Belgrave, D. and Doherty, G. (2020) Machine Learning in Mental Health: A Systematic Re-view of the HCI Literature to Support the Development of Effective and Imple-mentable ML Systems. ACM Transactions on Computer-Human Interaction, 27, 1-53. https://doi.org/10.1145/3398069
Holzinger, A., Dehmer, M., Em-mert-Streib, F., Cucchiara, R., Augenstein, I., Ser, J.D., et al. (2022) Information Fusion as an Integrative Cross-Cutting Enabler to Achieve Robust, Explainable, and Trustworthy Medical Artificial Intelligence. Information Fusion, 79, 263-278. https://doi.org/10.1016/j.inffus.2021.10.007
Feigenbaum, E.A. (2003) Some Challenges and Grand Challenges for Computational Intelli-gence. Journal of the ACM, 50, 32-40. https://doi.org/10.1145/602382.602400
Reinke, A., Tizabi, M.D., Ei-senmann, M. and Maier-Hein, L. (2021) Common Pitfalls and Recommendations for Grand Challenges in Medical Artificial Intelligence. European Urology Focus, 7, 710-712. https://doi.org/10.1016/j.euf.2021.05.008
Antoniadi, A.M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B.A., et al. (2021) Current Chal-lenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review. Applied Sciences, 11, Article 5088. https://doi.org/10.3390/app11115088
Speith, T. (2022) A Re-view of Taxonomies of Explainable Artificial Intelligence (XAI) Methods. 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, 21-24 June 2022, 2239-2250. https://doi.org/10.1145/3531146.3534639
Ozmen Garibay, O., Wins-low, B., Andolina, S., Antona, M., Bodenschatz, A., Coursaris, C., et al. (2023) Six Human-Centered Artificial Intelligence Grand Challenges. International Journal of Human—Computer Interaction, 39, 391-437. https://doi.org/10.1080/10447318.2022.2153320
Kemper, C. (2019) Kafkaesque AI? Legal Decision-Making in the Era of Machine Learning. Intellec-tual Property and Technology Law Journal, 24, 251-294. https://doi.org/10.31228/osf.io/4jzk2
Prokopenko, M. (2014) Grand Challenges for Computational Intelligence. Frontiers in Robotics and AI, 1, Arti-cle 2. https://doi.org/10.3389/frobt.2014.00002
von Gerich, H., Moen, H., Block, L.J., Chu, C.H., DeForest, H., Hobensack, M., et al. (2022) Artificial In-telligence—Based Technologies in Nursing: A Scoping Literature Review of the Evidence. International Journal of Nursing Studies, 127, Article 104153. https://doi.org/10.1016/j.ijnurstu.2021.104153
Coppola, F., Faggioni, L., Gabelloni, M., De Vietro, F., Mendola, V., Cattabriga, A., et al. (2021) Human, All Too Human? An All-Around Appraisal of the “Artificial Intelligence Revolution” in Medical Imaging. Frontiers in Psychology, 12, Article 710982. https://doi.org/10.3389/fpsyg.2021.710982
Shneiderman, B. (2020) Bridging the Gap between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-Centered AI Systems. ACM Transactions on Interactive In-telligent Systems, 10, 1-31. https://doi.org/10.1145/3419764
Zidaru, T., Morrow, E.M. and Stockley, R. (2021) Ensuring Patient and Public Involve-ment in the Transition to AI‐Assisted Mental Health Care: A Systematic Scoping Review and Agenda for Design Justice. Health Expectations, 24, 1072-1124. https://doi.org/10.1111/hex.13299
Javed, A.R., Ahmed, W., Pandya, S., Maddikunta, P.K.R., Alazab, M. and Gadekallu, T.R. (2023) A Survey of Ex-plainable Artificial Intelligence for Smart Cities. Electronics, 12, Article 1020. https://doi.org/10.3390/electronics12041020
Blacklaws, C. (2018) Al-gorithms: Transparency and Accountability. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 376, Article 20170351. https://doi.org/10.1098/rsta.2017.0351
Weinstock, R., Leong, G. and Silva, J. (2003) Ethical Guidelines. In: Rosner, R., Ed., Principles and Practice of Forensic Psychiatry, CRC Press, 56-72.
