Cognitive impairment is a frequent and debilitating outcome of stroke, profoundly affecting patient independence, recovery trajectories, and long-term quality of life. Despite its prevalence, accurate early prediction of post-stroke cognitive decline (PSCD) remains an unmet challenge due to the multifactorial interplay between structural brain lesions, neurophysiological changes, and diverse clinical comorbidities. In this study, we present a multimodal deep learning framework designed to classify stroke patients at risk of PSCD by jointly analysing synthetic magnetic resonance imaging (MRI), electroencephalography (EEG), and clinical features. The architecture comprises three modality-specific branches: a 3D convolutional neural network (CNN) to extract lesion-based structural patterns from MRI volumes, a 1D CNN for temporal feature extraction from EEG signals, and a multilayer perceptron for tabular clinical predictors. These representations are integrated through late fusion to enable comprehensive multimodal risk stratification. Experiments conducted on a balanced synthetic dataset (N = 800; MRI: 32 × 32 × 32, EEG: 8 × 256, Clinical: 12 features) demonstrated strong predictive performance, achieving a best validation area under the curve (AUC) of 0.7327, which outperformed all unimodal baselines. To enhance clinical interpretability, we employed permutation feature importance, gradient-based saliency mapping, and UMAP visualization of latent embeddings. Results highlighted clinically meaningful drivers of prediction, including baseline Montreal Cognitive Assessment (MoCA) scores, age, and lesion burden. Contribution analysis further confirmed that multimodal fusion consistently yielded superior predictive capacity compared to individual modalities. Although based on synthetic data, these findings establish a robust methodological foundation for multimodal AI-driven risk stratification in stroke rehabilitation. Future work will extend validation to real-world multi-center clinical datasets, investigate time-to-event modelling, and explore integration into clinical decision-support systems to guide personalized interventions.
Cite this paper
Filippis, R. D. and Foysal, A. A. (2026). Deep Learning for Predicting Post-Stroke Cognitive Decline Using Multimodal Data: A Synthetic Proof-of-Concept Study. Open Access Library Journal, 13, e14446. doi: http://dx.doi.org/10.4236/oalib.1114446.
Feigin, V.L., Barker-Collo, S., McNaughton, H., Brown, P. and Kerse, N. (2008) Long-term Neuropsychological and Functional Outcomes in Stroke Survivors: Current Evidence and Perspectives for New Research. International Journal of Stroke, 3, 33-40. https://doi.org/10.1111/j.1747-4949.2008.00177.x
Singh, R., Chen, S., Ganesh, A. and Hill, M.D. (2018) Long-Term Neurological, Vascular, and Mortal-ity Outcomes after Stroke. International Journal of Stroke, 13, 787-796. https://doi.org/10.1177/1747493018798526
Patel, M.D., Coshall, C., Rudd, A.G. and Wolfe, C.D.A. (2002) Cognitive Impairment after Stroke: Clinical Determinants and Its Associations with Long‐Term Stroke Outcomes. Journal of the American Geriatrics Society, 50, 700-706. https://doi.org/10.1046/j.1532-5415.2002.50165.x
Brainin, M., Tuomilehto, J., Heiss, W.‐D., Bornstein, N.M., Bath, P.M.W., Teuschl, Y., et al. (2014) Post‐Stroke Cognitive Decline: An Update and Perspectives for Clinical Research. European Journal of Neurology, 22, 229-e16. https://doi.org/10.1111/ene.12626
del Ser, T., Barba, R., Morin, M.M., Domingo, J., Cemillan, C., Pondal, M., et al. (2005) Evolution of Cognitive Im-pairment after Stroke and Risk Factors for Delayed Progression. Stroke, 36, 2670-2675. https://doi.org/10.1161/01.str.0000189626.71033.35
El Husseini, N., Katzan, I.L., Rost, N.S., Blake, M.L., Byun, E., Pendlebury, S.T., Apa-ricio, H. J., et al. (2023) Cognitive Impairment after Ischemic and Hemorrhagic Stroke: A Scientific Statement from the American Heart Association/American Stroke Association. Stroke, 54, e272-e291. https://doi.org/10.1161/STR.0000000000000430
Rost, N.S., Brodt-mann, A., Pase, M.P., van Veluw, S.J., Biffi, A., Duering, M., et al. (2022) Post-Stroke Cognitive Impairment and Dementia. Circulation Research, 130, 1252-1271. https://doi.org/10.1161/circresaha.122.319951
Berthier, M.L., Dávila, G., Edelkraut, L., López-Barroso, D., Torres-Prioris, M.J. and Tubío-Ordónez, J. (2020) Pharmacological Treatment of Post-Stroke Cognitive Deficits. In: Lazar, R., Pavol, M. and Browndyke, J., Eds., Neurovascular Neuro-psychology, Springer International Publishing, 465-500. https://doi.org/10.1007/978-3-030-49586-2_19
Khaw, J., Subrama-niam, P., Abd Aziz, N.A., Ali Raymond, A., Wan Zaidi, W.A. and Ghazali, S.E. (2021) Current Update on the Clinical Utility of MMSE and Moca for Stroke Pa-tients in Asia: A Systematic Review. International Journal of Environmental Re-search and Public Health, 18, Article 8962. https://doi.org/10.3390/ijerph18178962
Salvadori, E., Cova, I., Mele, F., Pomati, S. and Pantoni, L. (2022) Prediction of Post-Stroke Cognitive Impair-ment by Montreal Cognitive Assessment (MoCA) Performances in Acute Stroke: Comparison of Three Normative Datasets. Aging Clinical and Experimental Re-search, 34, 1855-1863. https://doi.org/10.1007/s40520-022-02133-9
Quinn, T.J., Richard, E., Teuschl, Y., Gattringer, T., Hafdi, M., O’Brien, J.T., et al. (2021) European Stroke Organisation and European Academy of Neurology Joint Guidelines on Post-Stroke Cognitive Impairment. European Stroke Journal, 6, 1-371. https://doi.org/10.1177/23969873211042192
Leskinen, S., Singha, S., Mehta, N.H., Quelle, M., Shah, H.A. and D’Amico, R.S. (2024) Applications of Functional Magnetic Resonance Imaging to the Study of Functional Connectivity and Activation in Neurological Disease: A Scoping Review of the Literature. World Neurosurgery, 189, 185-192. https://doi.org/10.1016/j.wneu.2024.06.003
Shaheen, H. and Melnik, R. (2025) Brain Network Dynamics and Multiscale Modeling of Neurodegenerative Disorders: A Review. IEEE Access, 13, 33074-33100. https://doi.org/10.1109/access.2025.3542634
Cassidy, J.M., Wodeyar, A., Srinivasan, R. and Cramer, S.C. (2021) Coherent Neural Oscillations Inform Early Stroke Motor Recovery. Human Brain Mapping, 42, 5636-5647. https://doi.org/10.1002/hbm.25643
Menon, V. (2011) Large-Scale Brain Networks and Psychopathology: A Unifying Triple Network Model. Trends in Cognitive Sciences, 15, 483-506. https://doi.org/10.1016/j.tics.2011.08.003
Clèrigues, A., Valverde, S., Bernal, J., Freixenet, J., Oliver, A. and Lladó, X. (2020) Acute and Sub-Acute Stroke Lesion Segmentation from Multimodal MRI. Computer Methods and Pro-grams in Biomedicine, 194, Article 105521. https://doi.org/10.1016/j.cmpb.2020.105521
Chen, Q., Xia, T., Zhang, M., Xia, N., Liu, J. and Yang, Y. (2021) Radiomics in Stroke Neuroimaging: Tech-niques, Applications, and Challenges. Aging and disease, 12, Article 143. https://doi.org/10.14336/ad.2020.0421
Shurrab, S., Guer-ra-Manzanares, A., Magid, A., Piechowski-Jozwiak, B., Atashzar, S.F. and Shamout, F.E. (2024) Multimodal Machine Learning for Stroke Prognosis and Diagnosis: A Systematic Review. IEEE Journal of Biomedical and Health Infor-matics, 28, 6958-6973. https://doi.org/10.1109/jbhi.2024.3448238
Mathew, P.S., Pillai, A.S., Abraham, A. and Biase, L.D. (2024) Neuroimaging and Deep Learning in Stroke Diagnosis: A Review of a Decade of Research. In: Pillai, A.S. and Menon, B., Eds., Machine Learning and Deep Learning in Neuroimaging Data Analysis, CRC Press, 1-24. https://doi.org/10.1201/9781003264767-1
Petrov, D., Marshall, N.W., Young, K.C. and Bosmans, H. (2019) Systematic Approach to a Channelized Hotelling Model Observer Implementation for a Physical Phantom Containing Mass-Like Lesions: Application to Digital Breast Tomosynthesis. Physica Medica, 58, 8-20. https://doi.org/10.1016/j.ejmp.2018.12.033
Yao, Q., Xiao, L., Liu, P. and Zhou, S.K. (2021) Label-Free Segmentation of COVID-19 Lesions in Lung CT. IEEE Transactions on Medical Imaging, 40, 2808-2819. https://doi.org/10.1109/tmi.2021.3066161
Garcia-Hernandez, J.J., Gomez-Flores, W. and Rubio-Loyola, J. (2016) Analysis of the Impact of Digital Watermarking on Computer-Aided Diagnosis in Medical Imaging. Computers in Biology and Medicine, 68, 37-48. https://doi.org/10.1016/j.compbiomed.2015.10.014
Rahman, G.M. (2016) Detection of Neural Activity for Cerebrovascular Disease using MRI and EEG. PhD Dissertation, Khulna University of Engineering & Technology (KUET).
Bernardes, T.S., Santos, K.C.S., Nascimento, M.R., Filho, C.A.N.e.S., Bazan, R., Pereira, J.M., et al. (2024) Effects of Anodal Transcranial Direct Current Stimulation over Motor Cortex on Resting-State Brain Activity in the Early Subacute Stroke Phase: A Power Spectral Density Analysis. Clinical Neurology and Neurosurgery, 237, Article 108134. https://doi.org/10.1016/j.clineuro.2024.108134
Hussain, I. and Park, S. (2021) Quantitative Evaluation of Task-Induced Neurological Outcome after Stroke. Brain Sciences, 11, Article 900. https://doi.org/10.3390/brainsci11070900
Claudio, B., Fabrizio, V., Roberta, L., Raffaele, F., Guido, R., Nicola, M., et al. (2011) Resting State Cortical Rhythms in Mild Cognitive Impairment and Alzheimer’s Disease: Electroen-cephalographic Evidence. Journal of Alzheimer's Disease, 26, 201-214.
Brown, P. and Marsden, C.D. (1999) Bradykinesia and Im-pairment of EEG Desynchronization in Parkinson’s Disease. Movement Disor-ders, 14, 423-429. https://doi.org/10.1002/1531-8257(199905)14:3<423::aid-mds1006>3.0.co;2-v
Khan, S.R., Manialawy, Y., Wheeler, M.B. and Cox, B.J. (2019) Unbi-ased Data Analytic Strategies to Improve Biomarker Discovery in Precision Medicine. Drug Discovery Today, 24, 1735-1748. https://doi.org/10.1016/j.drudis.2019.05.018
Knox, D., Lucas, C. and Cho, W.K.T. (2022) Testing Causal Theories with Learned Proxies. An-nual Review of Political Science, 25, 419-441. https://doi.org/10.1146/annurev-polisci-051120-111443
Valsesia, D., Fracastoro, G. and Magli, E. (2020) Deep Graph-Convolutional Image Denoising. IEEE Transactions on Image Processing, 29, 8226-8237. https://doi.org/10.1109/tip.2020.3013166
Kausar, A., Razzak, I., Shapiai, M.I. and Beheshti, A. (2021) 3D Shallow Deep Neural Network for Fast and Precise Segmentation of Left Atrium. Multimedia Systems, 29, 1739-1749. https://doi.org/10.1007/s00530-021-00776-8
Sun, Y., Pang, S., Zhang, Y. and Zhang, J. (2024) Application of the Dynamic Transformer Model with Well Logging Data for Formation Porosity Prediction. Physics of Fluids, 36, Arti-cle No. 036620. https://doi.org/10.1063/5.0193903
Stiglic, G., Kocbek, P., Fijacko, N., Zitnik, M., Verbert, K. and Cilar, L. (2020) Interpretability of Machine Learning‐Based Prediction Models in Healthcare. WIREs Data Mining and Knowledge Discovery, 10, e1379. https://doi.org/10.1002/widm.1379
Liu, X., Tian, J., Duan, P., Yu, Q., Wang, G. and Wang, Y. (2024) GrMoNAS: A Granularity-Based Multi-Objective NAS Framework for Efficient Medical Diagnosis. Computers in Biology and Med-icine, 171, Article ID: 108118.https://doi.org/10.1016/j.compbiomed.2024.108118
Anuyah, S., Singh, M.K., and Nyavor, H. (2024) Advancing Clinical Trial Out-Comes Using DEEP Learning and Predictive Modelling: Bridging Precision Medicine and Pa-tient-Centered Care. arXiv:2412.07050.
Rice, L., Wong, E. and Kolter, Z. (2020) Overfitting in Adversarially Robust Deep Learning. In: Proceedings of the 37th International Conference on Machine Learning, 8093-8104, PMLR.
Bian, K. and Priyadarshi, R. (2024) Machine Learning Optimization Techniques: A Survey, Classification, Challenges, and Future Research Issues. Archives of Computational Methods in Engineering, 31, 4209-4233. https://doi.org/10.1007/s11831-024-10110-w
Cai, L. (2024) Improving Neural Network Performance through Accelerated Learning and Simplified Ar-chitecture for Big Data Applications. PhD Dissertation, Royal Melbourne Insti-tute of Technology.
Sekhari, A., Sridharan, K. and Kale, S. (2021) SGD: The Role of Implicit Regularization, Batch-Size and Multiple-Epochs. Advances in Neural Information Processing Systems, 34, 27422-27433.
Wu, L. and Su, W.J. (2023) The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent. Proceedings of the 40th International Conference on Machine Learning, Honolulu, 23-29 July 2023, 37656-37684.
Jiménez-Valverde, A. (2014) Thresh-old-Dependence as a Desirable Attribute for Discrimination Assessment: Impli-cations for the Evaluation of Species Distribution Models. Biodiversity and Con-servation, 23, 369-385. https://doi.org/10.1007/s10531-013-0606-1
Wang, Z., Chang, Y.I., Ying, Z., Zhu, L. and Yang, Y. (2007) A Parsimonious Threshold-Independent Protein Feature Selection Method through the Area under Receiver Operating Charac-teristic Curve. Bioinformatics, 23, 2788-2794. https://doi.org/10.1093/bioinformatics/btm442
Bradley, A.P. (1997) The Use of the Area under the ROC Curve in the Evaluation of Machine Learn-ing Algorithms. Pattern Recognition, 30, 1145-1159. https://doi.org/10.1016/s0031-3203(96)00142-2
Anoch, B. and Par-thiban, L. (2025) Detection and Classification of Medical Images Using Deep Learning for Chronic Kidney Disease. International Urology and Nephrology. https://doi.org/10.1007/s11255-025-04786-7
Desai, A. and Mahto, R. (2025) Multi-Class Classification of Breast Cancer Subtypes Using Resnet Ar-chitectures on Histopathological Images. Journal of Imaging, 11, Article 284. https://doi.org/10.3390/jimaging11080284