全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

Deep Learning for Predicting Post-Stroke Cognitive Decline Using Multimodal Data: A Synthetic Proof-of-Concept Study

DOI: 10.4236/oalib.1114446, PP. 1-22

Subject Areas: Neurology

Keywords: Stroke, Cognitive Decline, Deep Learning, Multimodal Fusion, MRI, EEG, Clinical Data, Explainable AI

Full-Text   Cite this paper   Add to My Lib

Abstract

Cognitive impairment is a frequent and debilitating outcome of stroke, profoundly affecting patient independence, recovery trajectories, and long-term quality of life. Despite its prevalence, accurate early prediction of post-stroke cognitive decline (PSCD) remains an unmet challenge due to the multifactorial interplay between structural brain lesions, neurophysiological changes, and diverse clinical comorbidities. In this study, we present a multimodal deep learning framework designed to classify stroke patients at risk of PSCD by jointly analysing synthetic magnetic resonance imaging (MRI), electroencephalography (EEG), and clinical features. The architecture comprises three modality-specific branches: a 3D convolutional neural network (CNN) to extract lesion-based structural patterns from MRI volumes, a 1D CNN for temporal feature extraction from EEG signals, and a multilayer perceptron for tabular clinical predictors. These representations are integrated through late fusion to enable comprehensive multimodal risk stratification. Experiments conducted on a balanced synthetic dataset (N = 800; MRI: 32 × 32 × 32, EEG: 8 × 256, Clinical: 12 features) demonstrated strong predictive performance, achieving a best validation area under the curve (AUC) of 0.7327, which outperformed all unimodal baselines. To enhance clinical interpretability, we employed permutation feature importance, gradient-based saliency mapping, and UMAP visualization of latent embeddings. Results highlighted clinically meaningful drivers of prediction, including baseline Montreal Cognitive Assessment (MoCA) scores, age, and lesion burden. Contribution analysis further confirmed that multimodal fusion consistently yielded superior predictive capacity compared to individual modalities. Although based on synthetic data, these findings establish a robust methodological foundation for multimodal AI-driven risk stratification in stroke rehabilitation. Future work will extend validation to real-world multi-center clinical datasets, investigate time-to-event modelling, and explore integration into clinical decision-support systems to guide personalized interventions.

Cite this paper

Filippis, R. D. and Foysal, A. A. (2026). Deep Learning for Predicting Post-Stroke Cognitive Decline Using Multimodal Data: A Synthetic Proof-of-Concept Study. Open Access Library Journal, 13, e14446. doi: http://dx.doi.org/10.4236/oalib.1114446.

References

[1]  Feigin, V.L., Barker-Collo, S., McNaughton, H., Brown, P. and Kerse, N. (2008) Long-term Neuropsychological and Functional Outcomes in Stroke Survivors: Current Evidence and Perspectives for New Research. International Journal of Stroke, 3, 33-40. https://doi.org/10.1111/j.1747-4949.2008.00177.x
[2]  Singh, R., Chen, S., Ganesh, A. and Hill, M.D. (2018) Long-Term Neurological, Vascular, and Mortal-ity Outcomes after Stroke. International Journal of Stroke, 13, 787-796. https://doi.org/10.1177/1747493018798526
[3]  Patel, M.D., Coshall, C., Rudd, A.G. and Wolfe, C.D.A. (2002) Cognitive Impairment after Stroke: Clinical Determinants and Its Associations with Long‐Term Stroke Outcomes. Journal of the American Geriatrics Society, 50, 700-706. https://doi.org/10.1046/j.1532-5415.2002.50165.x
[4]  Elendu, C., Amaechi, D.C., Elendu, T.C., Ibhiedu, J.O., Egbunu, E.O., Ndam, A.R., et al. (2023) Stroke and Cognitive Impairment: Understanding the Connection and Managing Symptoms. Annals of Medicine & Surgery, 85, 6057-6066. https://doi.org/10.1097/ms9.0000000000001441
[5]  Huang, Y., Chen, S., Leng, X., Kuo, K., Wang, Z., Cui, M., et al. (2022) Post-Stroke Cognitive Impair-ment: Epidemiology, Risk Factors, and Management. Journal of Alzheimer’s Disease, 86, 983-999. https://doi.org/10.3233/jad-215644
[6]  Brainin, M., Tuomilehto, J., Heiss, W.‐D., Bornstein, N.M., Bath, P.M.W., Teuschl, Y., et al. (2014) Post‐Stroke Cognitive Decline: An Update and Perspectives for Clinical Research. European Journal of Neurology, 22, 229-e16. https://doi.org/10.1111/ene.12626
[7]  del Ser, T., Barba, R., Morin, M.M., Domingo, J., Cemillan, C., Pondal, M., et al. (2005) Evolution of Cognitive Im-pairment after Stroke and Risk Factors for Delayed Progression. Stroke, 36, 2670-2675. https://doi.org/10.1161/01.str.0000189626.71033.35
[8]  El Husseini, N., Katzan, I.L., Rost, N.S., Blake, M.L., Byun, E., Pendlebury, S.T., Apa-ricio, H. J., et al. (2023) Cognitive Impairment after Ischemic and Hemorrhagic Stroke: A Scientific Statement from the American Heart Association/American Stroke Association. Stroke, 54, e272-e291. https://doi.org/10.1161/STR.0000000000000430
[9]  Rost, N.S., Brodt-mann, A., Pase, M.P., van Veluw, S.J., Biffi, A., Duering, M., et al. (2022) Post-Stroke Cognitive Impairment and Dementia. Circulation Research, 130, 1252-1271. https://doi.org/10.1161/circresaha.122.319951
[10]  Berthier, M.L., Dávila, G., Edelkraut, L., López-Barroso, D., Torres-Prioris, M.J. and Tubío-Ordónez, J. (2020) Pharmacological Treatment of Post-Stroke Cognitive Deficits. In: Lazar, R., Pavol, M. and Browndyke, J., Eds., Neurovascular Neuro-psychology, Springer International Publishing, 465-500. https://doi.org/10.1007/978-3-030-49586-2_19
[11]  Khaw, J., Subrama-niam, P., Abd Aziz, N.A., Ali Raymond, A., Wan Zaidi, W.A. and Ghazali, S.E. (2021) Current Update on the Clinical Utility of MMSE and Moca for Stroke Pa-tients in Asia: A Systematic Review. International Journal of Environmental Re-search and Public Health, 18, Article 8962. https://doi.org/10.3390/ijerph18178962
[12]  Salvadori, E., Cova, I., Mele, F., Pomati, S. and Pantoni, L. (2022) Prediction of Post-Stroke Cognitive Impair-ment by Montreal Cognitive Assessment (MoCA) Performances in Acute Stroke: Comparison of Three Normative Datasets. Aging Clinical and Experimental Re-search, 34, 1855-1863. https://doi.org/10.1007/s40520-022-02133-9
[13]  Quinn, T.J., Richard, E., Teuschl, Y., Gattringer, T., Hafdi, M., O’Brien, J.T., et al. (2021) European Stroke Organisation and European Academy of Neurology Joint Guidelines on Post-Stroke Cognitive Impairment. European Stroke Journal, 6, 1-371. https://doi.org/10.1177/23969873211042192
[14]  Leskinen, S., Singha, S., Mehta, N.H., Quelle, M., Shah, H.A. and D’Amico, R.S. (2024) Applications of Functional Magnetic Resonance Imaging to the Study of Functional Connectivity and Activation in Neurological Disease: A Scoping Review of the Literature. World Neurosurgery, 189, 185-192. https://doi.org/10.1016/j.wneu.2024.06.003
[15]  Shaheen, H. and Melnik, R. (2025) Brain Network Dynamics and Multiscale Modeling of Neurodegenerative Disorders: A Review. IEEE Access, 13, 33074-33100. https://doi.org/10.1109/access.2025.3542634
[16]  Cassidy, J.M., Wodeyar, A., Srinivasan, R. and Cramer, S.C. (2021) Coherent Neural Oscillations Inform Early Stroke Motor Recovery. Human Brain Mapping, 42, 5636-5647. https://doi.org/10.1002/hbm.25643
[17]  Menon, V. (2011) Large-Scale Brain Networks and Psychopathology: A Unifying Triple Network Model. Trends in Cognitive Sciences, 15, 483-506. https://doi.org/10.1016/j.tics.2011.08.003
[18]  Clèrigues, A., Valverde, S., Bernal, J., Freixenet, J., Oliver, A. and Lladó, X. (2020) Acute and Sub-Acute Stroke Lesion Segmentation from Multimodal MRI. Computer Methods and Pro-grams in Biomedicine, 194, Article 105521. https://doi.org/10.1016/j.cmpb.2020.105521
[19]  Chen, Q., Xia, T., Zhang, M., Xia, N., Liu, J. and Yang, Y. (2021) Radiomics in Stroke Neuroimaging: Tech-niques, Applications, and Challenges. Aging and disease, 12, Article 143. https://doi.org/10.14336/ad.2020.0421
[20]  Shurrab, S., Guer-ra-Manzanares, A., Magid, A., Piechowski-Jozwiak, B., Atashzar, S.F. and Shamout, F.E. (2024) Multimodal Machine Learning for Stroke Prognosis and Diagnosis: A Systematic Review. IEEE Journal of Biomedical and Health Infor-matics, 28, 6958-6973. https://doi.org/10.1109/jbhi.2024.3448238
[21]  Mathew, P.S., Pillai, A.S., Abraham, A. and Biase, L.D. (2024) Neuroimaging and Deep Learning in Stroke Diagnosis: A Review of a Decade of Research. In: Pillai, A.S. and Menon, B., Eds., Machine Learning and Deep Learning in Neuroimaging Data Analysis, CRC Press, 1-24. https://doi.org/10.1201/9781003264767-1
[22]  Petrov, D., Marshall, N.W., Young, K.C. and Bosmans, H. (2019) Systematic Approach to a Channelized Hotelling Model Observer Implementation for a Physical Phantom Containing Mass-Like Lesions: Application to Digital Breast Tomosynthesis. Physica Medica, 58, 8-20. https://doi.org/10.1016/j.ejmp.2018.12.033
[23]  Yao, Q., Xiao, L., Liu, P. and Zhou, S.K. (2021) Label-Free Segmentation of COVID-19 Lesions in Lung CT. IEEE Transactions on Medical Imaging, 40, 2808-2819. https://doi.org/10.1109/tmi.2021.3066161
[24]  Garcia-Hernandez, J.J., Gomez-Flores, W. and Rubio-Loyola, J. (2016) Analysis of the Impact of Digital Watermarking on Computer-Aided Diagnosis in Medical Imaging. Computers in Biology and Medicine, 68, 37-48. https://doi.org/10.1016/j.compbiomed.2015.10.014
[25]  Rahman, G.M. (2016) Detection of Neural Activity for Cerebrovascular Disease using MRI and EEG. PhD Dissertation, Khulna University of Engineering & Technology (KUET).
[26]  Bernardes, T.S., Santos, K.C.S., Nascimento, M.R., Filho, C.A.N.e.S., Bazan, R., Pereira, J.M., et al. (2024) Effects of Anodal Transcranial Direct Current Stimulation over Motor Cortex on Resting-State Brain Activity in the Early Subacute Stroke Phase: A Power Spectral Density Analysis. Clinical Neurology and Neurosurgery, 237, Article 108134. https://doi.org/10.1016/j.clineuro.2024.108134
[27]  Hussain, I. and Park, S. (2021) Quantitative Evaluation of Task-Induced Neurological Outcome after Stroke. Brain Sciences, 11, Article 900. https://doi.org/10.3390/brainsci11070900
[28]  Hall, S.D., Yamawaki, N., Fisher, A.E., Clauss, R.P., Woodhall, G.L. and Stanford, I.M. (2010) GABA(A) Alpha-1 Subunit Mediated Desynchronization of Elevated Low Frequency Oscil-lations Alleviates Specific Dysfunction in Stroke—A Case Report. Clinical Neu-rophysiology, 121, 549-555. https://doi.org/10.1016/j.clinph.2009.11.084
[29]  Claudio, B., Fabrizio, V., Roberta, L., Raffaele, F., Guido, R., Nicola, M., et al. (2011) Resting State Cortical Rhythms in Mild Cognitive Impairment and Alzheimer’s Disease: Electroen-cephalographic Evidence. Journal of Alzheimer's Disease, 26, 201-214.
[30]  Brown, P. and Marsden, C.D. (1999) Bradykinesia and Im-pairment of EEG Desynchronization in Parkinson’s Disease. Movement Disor-ders, 14, 423-429. https://doi.org/10.1002/1531-8257(199905)14:3<423::aid-mds1006>3.0.co;2-v
[31]  Khan, S.R., Manialawy, Y., Wheeler, M.B. and Cox, B.J. (2019) Unbi-ased Data Analytic Strategies to Improve Biomarker Discovery in Precision Medicine. Drug Discovery Today, 24, 1735-1748. https://doi.org/10.1016/j.drudis.2019.05.018
[32]  Morris, T.P., Walker, A.S., Williamson, E.J. and White, I.R. (2022) Planning a Method for Covariate Ad-justment in Individually Randomised Trials: A Practical Guide. Trials, 23, Article No. 328. https://doi.org/10.1186/s13063-022-06097-z
[33]  Knox, D., Lucas, C. and Cho, W.K.T. (2022) Testing Causal Theories with Learned Proxies. An-nual Review of Political Science, 25, 419-441. https://doi.org/10.1146/annurev-polisci-051120-111443
[34]  Valsesia, D., Fracastoro, G. and Magli, E. (2020) Deep Graph-Convolutional Image Denoising. IEEE Transactions on Image Processing, 29, 8226-8237. https://doi.org/10.1109/tip.2020.3013166
[35]  Kausar, A., Razzak, I., Shapiai, M.I. and Beheshti, A. (2021) 3D Shallow Deep Neural Network for Fast and Precise Segmentation of Left Atrium. Multimedia Systems, 29, 1739-1749. https://doi.org/10.1007/s00530-021-00776-8
[36]  Sun, Y., Pang, S., Zhang, Y. and Zhang, J. (2024) Application of the Dynamic Transformer Model with Well Logging Data for Formation Porosity Prediction. Physics of Fluids, 36, Arti-cle No. 036620. https://doi.org/10.1063/5.0193903
[37]  Stiglic, G., Kocbek, P., Fijacko, N., Zitnik, M., Verbert, K. and Cilar, L. (2020) Interpretability of Machine Learning‐Based Prediction Models in Healthcare. WIREs Data Mining and Knowledge Discovery, 10, e1379. https://doi.org/10.1002/widm.1379
[38]  Liu, X., Tian, J., Duan, P., Yu, Q., Wang, G. and Wang, Y. (2024) GrMoNAS: A Granularity-Based Multi-Objective NAS Framework for Efficient Medical Diagnosis. Computers in Biology and Med-icine, 171, Article ID: 108118.https://doi.org/10.1016/j.compbiomed.2024.108118
[39]  Anuyah, S., Singh, M.K., and Nyavor, H. (2024) Advancing Clinical Trial Out-Comes Using DEEP Learning and Predictive Modelling: Bridging Precision Medicine and Pa-tient-Centered Care. arXiv:2412.07050.
[40]  Santos, C.F.G.D. and Papa, J.P. (2022) Avoiding Overfitting: A Survey on Regularization Methods for Convolu-tional Neural Networks. ACM Computing Surveys, 54, 1-25. https://doi.org/10.1145/3510413
[41]  Rice, L., Wong, E. and Kolter, Z. (2020) Overfitting in Adversarially Robust Deep Learning. In: Proceedings of the 37th International Conference on Machine Learning, 8093-8104, PMLR.
[42]  Bian, K. and Priyadarshi, R. (2024) Machine Learning Optimization Techniques: A Survey, Classification, Challenges, and Future Research Issues. Archives of Computational Methods in Engineering, 31, 4209-4233. https://doi.org/10.1007/s11831-024-10110-w
[43]  Cai, L. (2024) Improving Neural Network Performance through Accelerated Learning and Simplified Ar-chitecture for Big Data Applications. PhD Dissertation, Royal Melbourne Insti-tute of Technology.
[44]  Sekhari, A., Sridharan, K. and Kale, S. (2021) SGD: The Role of Implicit Regularization, Batch-Size and Multiple-Epochs. Advances in Neural Information Processing Systems, 34, 27422-27433.
[45]  Wu, L. and Su, W.J. (2023) The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent. Proceedings of the 40th International Conference on Machine Learning, Honolulu, 23-29 July 2023, 37656-37684.
[46]  Luo, P., Wang, X., Shao, W. and Peng, Z. (2018) Towards Under-Standing Regularization in Batch Normalization. arXiv:1809.00846.
[47]  Jiménez-Valverde, A. (2014) Thresh-old-Dependence as a Desirable Attribute for Discrimination Assessment: Impli-cations for the Evaluation of Species Distribution Models. Biodiversity and Con-servation, 23, 369-385. https://doi.org/10.1007/s10531-013-0606-1
[48]  Wang, Z., Chang, Y.I., Ying, Z., Zhu, L. and Yang, Y. (2007) A Parsimonious Threshold-Independent Protein Feature Selection Method through the Area under Receiver Operating Charac-teristic Curve. Bioinformatics, 23, 2788-2794. https://doi.org/10.1093/bioinformatics/btm442
[49]  Bradley, A.P. (1997) The Use of the Area under the ROC Curve in the Evaluation of Machine Learn-ing Algorithms. Pattern Recognition, 30, 1145-1159. https://doi.org/10.1016/s0031-3203(96)00142-2
[50]  Anoch, B. and Par-thiban, L. (2025) Detection and Classification of Medical Images Using Deep Learning for Chronic Kidney Disease. International Urology and Nephrology. https://doi.org/10.1007/s11255-025-04786-7
[51]  Desai, A. and Mahto, R. (2025) Multi-Class Classification of Breast Cancer Subtypes Using Resnet Ar-chitectures on Histopathological Images. Journal of Imaging, 11, Article 284. https://doi.org/10.3390/jimaging11080284

Full-Text


Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133