Recent advances in virtual reality (VR) technology and AI-driven speech detection have opened new avenues for cognitive screening. This study integrates the Mini-Mental State Examination (MMSE) within a VR environment, coupled with AI-based speech detection, to enhance diagnostic accuracy and patient engagement in detecting early signs of Alzheimer’s disease. Eighteen participants diagnosed with early symptoms of Alzheimer’s disease were assessed using both traditional and VR-based MMSE methods. The VR system included immersive environments, motion tracking, and electrophysiological sensors to provide a comprehensive and interactive assessment. AI-based speech metrics, including speech latency, frequency of speech errors, and response completeness, were automatically extracted and compared with traditional MMSE scoring. Statistical analysis using intraclass correlation coefficients (ICCs) demonstrated excellent agreement between traditional and VR-based MMSE scores. The results indicate that the VR-based approach, combined with AI-driven speech detection, offers reliable and accurate cognitive assessments, supporting its potential for early detection of Alzheimer’s disease. This innovative approach promises to transform cognitive screening by providing a more engaging and standardized testing environment.
References
[1]
Baus, O. and Bouchard, S. (2014) Moving from Virtual Reality Exposure-Based Therapy to Augmented Reality Exposure-Based Therapy: A Review. Frontiers in Human Neuroscience, 8, Article ID: 112. https://doi.org/10.3389/fnhum.2014.00112
[2]
Society of Clinical Psychology (n.d.) What Is Exposure Therapy? American Psy-chological Association: Division 12. https://www.apa.org/ptsd-guideline/patients-and-families/exposure-therapy
[3]
Caravas, P., Kritikos, J., Alevizopoulos, G. and Koutsouris, D. (2021) Participant Modeling: The Use of a Guided Master in the Modern World of Virtual Reality Exposure Therapy Targeting Fear of Heights. In: Perego, P., TaheriNejad, N. and Caon, M., Eds., Lecture Notes of the Institute for Computer Sciences, Social In-formatics and Telecommunications Engineering, Springer International Pub-lishing, 161-174. https://doi.org/10.1007/978-3-030-76066-3_13
[4]
McCarten, J.R., Rottunda, S.J. and Kuskowski, M.A. (2004) Change in the Mini-Mental State Exam in Alzheimer’s Disease over 2 Years: The Experience of a Dementia Clinic. Journal of Alzheimer’s Disease, 6, 11-15. https://doi.org/10.3233/jad-2004-6102
[5]
Lee, J., Lee, H., Yoo, H.B., Choi, J., Jung, H., Yoon, E.J., et al. (2019) Efficacy of Cilostazol Administration in Alzheimer’s Disease Patients with White Matter Le-sions: A Positron-Emission Tomography Study. Neurotherapeutics, 16, 394-403. https://doi.org/10.1007/s13311-018-00708-x
[6]
König, A., et al., (2015) Automatic Speech Analysis for the Assessment of Pa-tients with Predementia and Alzheimer’s Disease. Alzheimer’s and Dementia: Diagnosis, Assessment and Disease Monitoring, 1, 112-124.
[7]
Gautam, P. and Singh, M. (2025) Alzheimer’s Disease Classification Using the Fusion of Improved 3D-VGG-16 and Machine Learning Classifiers. International Journal of Biomedical Engineering and Technology, 47, 1-27. https://doi.org/10.1504/ijbet.2025.143776
[8]
Clay, F., Howett, D., FitzGerald, J., Fletcher, P., Chan, D. and Price, A. (2020) Use of Immersive Virtual Reality in the Assessment and Treatment of Alzheimer’s Disease: A Systematic Review. Journal of Alzheimer’s Disease, 75, 23-43. https://doi.org/10.3233/jad-191218
[9]
Kritikos, I., Tzannetos, G., Zoitaki, C., Poulopoulou, S. and Koutsouris, D. (2019) Anxiety Detection from Electrodermal Activity Sensor with Movement & Inter-action during Virtual Reality Simulation. 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER), San Francisco, 20-23 March 2019, 571-576. https://doi.org/10.1109/ner.2019.8717170
[10]
Yeh, S.-C., Li, Y.-Y, Zhou, C., Chiu, P.-H. and Chen, J.-W. (2017) Effects of Virtual Reality and Augmented Reality on Induced Anxiety. IEEE Transactions on Neu-ral Systems and Rehabilitation Engineering, 26, 1345-1352.
[11]
Otte, C. (2011) Cognitive Behavioral Therapy in Anxiety Disorders: Current State of the Evidence. Dialogues in Clinical Neuroscience, 13, 413-421. https://doi.org/10.31887/dcns.2011.13.4/cotte
[12]
Kritikos, J., Poulopoulou, S., Zoitaki, C., Douloudi, M. and Koutsouris, D. (2019) Full Body Immersive Virtual Reality System with Motion Recognition Camera Targeting the Treatment of Spider Phobia. In: Cipresso, P., Serino, S. and Villani, D., Eds., Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Springer International Publishing, 216-230. https://doi.org/10.1007/978-3-030-25872-6_18
[13]
Foa, E.B., Chrestman, K.R. and Gilboa-Schechtman, E. (2009) Prolonged Expo-sure Therapy for Adolescents with PTSD: Emotional Processing of Traumatic Experiences: Therapist Guide. Oxford University Press. https://doi.org/10.1093/med:psych/9780195331745.001.0001
[14]
Beidel, D.C., Frueh, B.C., Neer, S.M., Bowers, C.A., Trachik, B., Uhde, T.W., et al. (2019) Trauma Management Therapy with Virtual-Reality Augmented Expo-sure Therapy for Combat-Related PTSD: A Randomized Controlled Trial. Journal of Anxiety Disorders, 61, 64-74. https://doi.org/10.1016/j.janxdis.2017.08.005
[15]
Alevizopoulos, A., Kritikos, J. and Alevizopoulos, G. (2021) Intelligent Machines and Mental Health in the Era of Covid-19. Psychiatriki, 32, 99-102. https://doi.org/10.22365/jpsych.2021.015
[16]
Kritikos, I., Zoitaki, C., Tzannetos, G., Mehmeti, A., Douloudi, M., Nikolaou, G., et al. (2020) Comparison between Full Body Motion Recognition Camera Interac-tion and Hand Controllers Interaction Used in Virtual Reality Exposure Therapy for Acrophobia. Sensors, 20, Article 1244. https://doi.org/10.3390/s20051244
[17]
Thakare, A.E., Mehrotra, R. and Singh, A. (2017) Effect of Music Tempo on Ex-ercise Performance and Heart Rate among Young Adults. International Journal of Physiology, Pathophysiology and Pharmacology, 9, 35-39.
[18]
Hussain, I. and Park, S.J. (2020) HealthSOS: Real-Time Health Monitoring Sys-tem for Stroke Prognostics. IEEE Access, 8, 213574-213586. https://doi.org/10.1109/access.2020.3040437
[19]
Kritikos, I., Mehmeti, A., Nikolaou, G. and Koutsouris, D. (2019) Fully Portable Low-Cost Motion Capture System with Real-Time Feedback for Rehabilitation Treatment. 2019 International Conference on Virtual Rehabilitation (ICVR), Tel Aviv, 21-24 July 2019, 1-8. https://doi.org/10.1109/icvr46560.2019.8994561
[20]
Konstantina, A. and Iakovos, K. (2024) Virtual Reality, Electrophysiology & Mo-tion Tracking Technologies in Mental Illnesses. Annals of Psychiatry and Treat-ment, 8, 23-26. https://doi.org/10.17352/apt.000060
[21]
Scheggi, S., Meli, L., Pacchierotti, C. and Prattichizzo, D. (2015) Touch the Virtu-al Reality: Using the Leap Motion Controller for Hand Tracking and Wearable Tactile Devices for Immersive Haptic Rendering. ACM SIGGRAPH 2015 Posters, Los Angeles, 9-13 August 2015, Article No. 31. https://doi.org/10.1145/2787626.2792651
[22]
Kritikos, J., Alevizopoulos, G. and Koutsouris, D. (2021) Personalized Virtual Re-ality Human-Computer Interaction for Psychiatric and Neurological Illnesses: A Dynamically Adaptive Virtual Reality Environment That Changes According to Real-Time Feedback from Electrophysiological Signal Responses. Frontiers in Human Neuroscience, 15, Article ID: 596980. https://doi.org/10.3389/fnhum.2021.596980
[23]
Kritikos, I., Sarantopoulos, A., Roumeliotis, A., Vasiliades, J. and Matsinas, I. (2025) Unlocking the Potential of Artificial Intelligence in Pharma Research and Development: Insights from Investor and Researcher Perspectives. Health Eco-nomics and Management Review, 6, 1-16. https://doi.org/10.61093/hem.2025.2-01
[24]
Kritikos, I., Caravas, P., Tzannetos, G., Douloudi, M. and Koutsouris, D. (2019) Emotional Stimulation during Motor Exercise: An Integration to the Holistic Re-habilitation Framework. 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, 23-27 July 2019, 4604-4610. https://doi.org/10.1109/embc.2019.8857548
[25]
König, A., Köhler, S., Tröger, J., Düzel, E., Glanz, W., Butryn, M., et al. (2024) Automated Remote Speech‐Based Testing of Individuals with Cognitive Decline: Bayesian Agreement of Transcription Accuracy. Alzheimer’s & Dementia: Diag-nosis, Assessment & Disease Monitoring, 16, e70011. https://doi.org/10.1002/dad2.70011
[26]
Zhao, X., Hu, R., Wen, H., Xu, G., Pang, T., He, X., et al. (2022) A Voice Recogni-tion-Based Digital Cognitive Screener for Dementia Detection in the Community: Development and Validation Study. Frontiers in Psychiatry, 13, Article ID: 899729. https://doi.org/10.3389/fpsyt.2022.899729
[27]
Jang, S., Choi, S., Son, S.J., Oh, J., Ha, J., Kim, W.J., et al. (2023) Virtual Reali-ty-Based Monitoring Test for MCI: A Multicenter Feasibility Study. Frontiers in Psychiatry, 13, Article ID: 1057513. https://doi.org/10.3389/fpsyt.2022.1057513
[28]
Min, J., Kim, D., Jang, H., Kim, H., Kim, S., Lee, S., et al. (2025) The Validity of a Smartphone-Based Application for Assessing Cognitive Function in the Elderly. Diagnostics, 15, Article 92. https://doi.org/10.3390/diagnostics15010092
[29]
Qiao, Y., et al. (2020) Computer-Assisted Speech Analysis in Mild Cognitive Impairment and Alzheimer’s Disease: A Pilot Study from Shanghai, China. Journal of Alzheimer’s Disease, 75, 211-221. https://doi.org/10.3233/JAD-191056
[30]
Koo, T.K. and Li, M.Y. (2016) A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medi-cine, 15, 155-163. https://doi.org/10.1016/j.jcm.2016.02.012
[31]
Yan, M., Yin, H., Meng, Q., Wang, S., Ding, Y., Li, G., et al. (2021) A Virtual Su-permarket Program for the Screening of Mild Cognitive Impairment in Older Adults: Diagnostic Accuracy Study. JMIR Serious Games, 9, e30919. https://doi.org/10.2196/30919
[32]
Rizzo, A.S. (2019) Clinical Virtual Reality in Mental Health and Rehabilitation: A Brief Review of the Future! Infrared Technology and Applications XLV, 11002, 150-158.
[33]
Fraser, K.C., Meltzer, J.A. and Rudzicz, F. (2015) Linguistic Features Identify Alzheimer’s Disease in Narrative Speech. Journal of Alzheimer’s Disease, 49, 407-422. https://doi.org/10.3233/JAD-150520
[34]
Kritikos, J., Makrypidis, A., Alevizopoulos, A., Alevizopoulos, G. and Koutsouris, D. (2023) Can Brain-Computer Interfaces Replace Virtual Reality Controllers? A Machine Learning Movement Prediction Model during Virtual Reality Simulation Using EEG Recordings. Virtual Worlds, 2, 182-202. https://doi.org/10.3390/virtualworlds2020011
