全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

Enhanced Predictive Modelling for Delirium in Intensive Care Using Simplified Deep Learning Architecture with Attention Mechanism

DOI: 10.4236/oalib.1112745, PP. 1-18

Subject Areas: Artificial Intelligence

Keywords: Delirium Prediction, ICU Monitoring, Deep Learning, Attention Mechanism, LSTM Model, Time-Series Analysis, Risk Stratification

Full-Text   Cite this paper   Add to My Lib

Abstract

Delirium is a common yet critical condition among Intensive Care Unit (ICU) patients, characterized by acute cognitive disturbances that can lead to severe complications, prolonged hospital stays, and increased mortality rates. Early detection and proactive management of delirium are essential to mitigate its adverse effects. This study introduces a novel deep learning model designed to predict the onset of delirium in ICU patients, aiming to assist healthcare professionals in identifying high-risk individuals at an early stage. Our approach integrates both static and dynamic patient data—capturing baseline characteristics and real-time physiological trends—to provide a comprehensive risk assessment framework. The model architecture employs a simplified Long Short-Term Memory (LSTM) network enhanced with an attention mechanism, which enables the model to focus on critical time points in dynamic patient data. This allows for a more interpretable and effective prediction of delirium risk by weighing the most relevant signals in the patient’s physiological timeline. Static features such as age, APACHE-II score, and comorbidity levels are combined with dynamic features, including vital signs monitored over time (e.g., heart rate, blood pressure, and respiratory rate), to form a holistic representation of each patient’s health status. Synthetic data was generated to simulate realistic ICU scenarios, with clear patterns introduced to mimic the physiological changes associated with delirium onset. The model was evaluated using a comprehensive set of metrics, including accuracy, Area Under the Receiver Operating Characteristic (ROC-AUC), and Area Under the Precision-Recall Curve (PR-AUC). The results demonstrate that the model achieved near-perfect performance on synthetic data, with an AUC of 1.00 in both ROC and PR curves, and a classification report indicating 100% precision, recall, and F1-score for both classes. The model’s rapid convergence and stable validation metrics further confirm its robustness and effectiveness in identifying delirium cases within a simulated ICU dataset. While these results highlight the model’s potential for real-time delirium prediction, it is important to recognize the limitations of synthetic data in capturing the full complexity of clinical settings. Future work will focus on validating the model with real-world ICU data to assess its generalizability and adaptability to diverse patient populations. Additionally, improvements to the synthetic data generation process, such as introducing variability within each class and incorporating potential confounding factors, will enhance the realism of simulated ICU data for further testing. The attention-based LSTM model presented in this study represents a promising tool for ICU delirium risk stratification, providing a foundation for further advancements in AI-driven healthcare solutions aimed at improving patient outcomes through early intervention).

Cite this paper

Filippis, R. D. and Foysal, A. A. (2025). Enhanced Predictive Modelling for Delirium in Intensive Care Using Simplified Deep Learning Architecture with Attention Mechanism. Open Access Library Journal, 12, e2745. doi: http://dx.doi.org/10.4236/oalib.1112745.

References

[1]  Wilson, J.E., Mart, M.F., Cunningham, C., Shehabi, Y., Girard, T.D., MacLullich, A.M.J., et al. (2020) Delirium. Nature Reviews Disease Primers, 6, Article No. 90.https://doi.org/10.1038/s41572-020-00223-4
[2]  Mehta, S., Cook, D., Devlin, J.W., Skrobik, Y., Meade, M., Fergusson, D., et al. (2015) Prevalence, Risk Factors, and Outcomes of Delirium in Mechanically Ventilated Adults. Criti-cal Care Medicine, 43, 557-566. https://doi.org/10.1097/ccm.0000000000000727
[3]  Kumar, V., Angu-rana, S.K., Baranwal, A.K. and Nallasamy, K. (2021) Nasotracheal Vs. Oro-tracheal Intubation and Post-Extubation Airway Obstruction in Critically Ill Children: An Open-Label Randomized Controlled Trial. Frontiers in Pediatrics, 9, Article 713516. https://doi.org/10.3389/fped.2021.713516
[4]  Nielsen, A.H., Larsen, L.K., Collet, M.O., Lehmkuhl, L., Bekker, C., Jensen, J.F., et al. (2023) Intensive Care Unit Nurses’ Perception of Three Different Methods for Delirium Screening: A Survey (Delis-3). Australian Critical Care, 36, 1035-1042. https://doi.org/10.1016/j.aucc.2022.12.008
[5]  Saad, R., Husnain, A., Saeed, A., Gill, A.Y. and Hussain, H.K. (2023) Harnessing Predictive Power: Exploring the Crucial Role of Machine Learning in Early Disease Detec-tion. Jurnal Inovasi dan Humaniora, 1, 302-315.
[6]  Rush, B., Celi, L.A. and Stone, D.J. (2018) Applying Machine Learning to Continuously Monitored Physiological Data. Journal of Clinical Monitoring and Computing, 33, 887-893. https://doi.org/10.1007/s10877-018-0219-z
[7]  Cheng, F., Joshi, H., Tan-don, P., Freeman, R., Reich, D.L., Mazumdar, M., et al. (2020) Using Machine Learning to Predict ICU Transfer in Hospitalized COVID-19 Patients. Journal of Clinical Medicine, 9, Article 1668. https://doi.org/10.3390/jcm9061668
[8]  Xu, Z., Guo, J., Qin, L., Xie, Y., Xiao, Y., Lin, X., et al. (2024) Predicting ICU Interventions: A Transparent Decision Support Model Based on Multivariate Time Series Graph Convolutional Neural Network. IEEE Journal of Biomedical and Health Informatics, 28, 3709-3720. https://doi.org/10.1109/jbhi.2024.3379998
[9]  Ahmedt-Aristizabal, D., Armin, M.A., Denman, S., Fookes, C. and Petersson, L. (2021) Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future. Sensors, 21, Article 4758. https://doi.org/10.3390/s21144758
[10]  Yan, Q., Lu, Z., Liu, H., He, X., Zhang, X. and Guo, J. (2024) Short-Term Prediction of In-tegrated Energy Load Aggregation Using a Bi-Directional Simple Recurrent Unit Network with Feature-Temporal Attention Mechanism Ensemble Learning Model. Applied Energy, 355, Article 122159. https://doi.org/10.1016/j.apenergy.2023.122159
[11]  Albahri, A.S., Duhaim, A.M., Fadhel, M.A., Alnoor, A., Baqer, N.S., Alzubaidi, L., et al. (2023) A Systematic Review of Trustworthy and Explainable Artificial Intelligence in Healthcare: Assessment of Quality, Bias Risk, and Data Fusion. Information Fu-sion, 96, 156-191. https://doi.org/10.1016/j.inffus.2023.03.008
[12]  Roz-zini, R., Sabatini, T., Cassinadri, A., Boffelli, S., Ferri, M., Barbisoni, P., et al. (2005) Relationship between Functional Loss before Hospital Admission and Mortality in Elderly Persons with Medical Illness. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 60, 1180-1183. https://doi.org/10.1093/gerona/60.9.1180
[13]  Zhang, Y.L. (2021) An In-teractive Machine Learning Approach to Integrating Physician Expertise into Delirium Prediction Model Development. Master’s Thesis, University of Toronto (Canada).
[14]  Dowell, E.H. and Hall, K.C. (2001) Modeling of Fluid-Structure Interaction. Annual Review of Fluid Mechanics, 33, 445-490. https://doi.org/10.1146/annurev.fluid.33.1.445
[15]  Li, Y., Zhu, Z., Kong, D., Han, H. and Zhao, Y. (2019) EA-LSTM: Evolutionary Attention-Based LSTM for Time Series Prediction. Knowledge-Based Systems, 181, Article 104785. https://doi.org/10.1016/j.knosys.2019.05.028
[16]  Sheikhalishahi, S., Bhattacharyya, A., Celi, L.A. and Osmani, V. (2023) An Interpretable Deep Learning Model for Time-Series Electronic Health Records: Case Study of Delir-ium Prediction in Critical Care. Artificial Intelligence in Medicine, 144, Article 102659. https://doi.org/10.1016/j.artmed.2023.102659
[17]  Yeung, M., Sala, E., Schönlieb, C. and Rundo, L. (2022) Unified Focal Loss: Generalising Dice and Cross Entropy-Based Losses to Handle Class Imbalanced Medical Image Segmentation. Computerized Medical Imaging and Graphics, 95, Article 102026. https://doi.org/10.1016/j.compmedimag.2021.102026
[18]  Mushava, J. and Murray, M. (2024) Flexible Loss Functions for Binary Classification in Gradi-ent-Boosted Decision Trees: An Application to Credit Scoring. Expert Systems with Applications, 238, Article 121876. https://doi.org/10.1016/j.eswa.2023.121876
[19]  Varshney, R.P. and Shar-ma, D.K. (2024) Optimizing Time-Series Forecasting Using Stacked Deep Learning Framework with Enhanced Adaptive Moment Estimation and Error Correction. Expert Systems with Applications, 249, Article 123487. https://doi.org/10.1016/j.eswa.2024.123487
[20]  Zhao, C., Badrinarayanan, V., Lee, C.-Y. and Rabinovich, A. (2018) Gradnorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks. International Conference on Machine Learning, Sweden, 10-15 July 2018, 794-803.
[21]  Aryafar, E., Khojastepour, M.A., Sundaresan, K., Rangarajan, S. and Knightly, E. (2013) ADAM: An Adaptive Beamforming System for Multicasting in Wireless Lans. IEEE/ACM Transactions on Networking, 21, 1595-1608. https://doi.org/10.1109/tnet.2012.2228501
[22]  Thabtah, F., Hammoud, S., Kamalov, F. and Gonsalves, A. (2020) Data Imbalance in Classification: Experi-mental Evaluation. Information Sciences, 513, 429-441. https://doi.org/10.1016/j.ins.2019.11.004
[23]  Bradley, A.P. (1997) The Use of the Area under the ROC Curve in the Evaluation of Machine Learning Algorithms. Pattern Recognition, 30, 1145-1159. https://doi.org/10.1016/s0031-3203(96)00142-2
[24]  Lv, S.R., Li, J.Q., He, H., Zhao, Q. and Jiang, Y.N. (2024) Artificial Intelligence Applications in Deliri-um Prediction, Diagnosis, and Management: A Systematic Review.
[25]  Gul-shan, S. (2023) Evaluation of Risk Factors for Falls in the Elderly Based on a Re-al Data Set Using Bayesian Networks. PhD Dissertation, Université Polytech-nique Hauts-de-France.
[26]  Chicco, D. and Jurman, G. (2020) The Advantages of the Matthews Correlation Coefficient (MCC) over F1 Score and Accuracy in Binary Classification Evaluation. BMC Genomics, 21, 1-13. https://doi.org/10.1186/s12864-019-6413-7
[27]  Al-rimy, B.A.S., Saeed, F., Al-Sarem, M., Albarrak, A.M. and Qasem, S.N. (2023) An Adaptive Early Stop-ping Technique for Densenet 169-Based Knee Osteoarthritis Detection Model. Diagnostics, 13, Article 1903. https://doi.org/10.3390/diagnostics13111903
[28]  Miseta, T., Fodor, A. and Vathy-Fogarassy, á. (2024) Surpassing Early Stopping: A Novel Correla-tion-Based Stopping Criterion for Neural Networks. Neurocomputing, 567, Ar-ticle 127028. https://doi.org/10.1016/j.neucom.2023.127028
[29]  Kumar, A., Parkash, C., Tang, H. and Xiang, J. (2023) Intelligent Framework for Degra-dation Monitoring, Defect Identification and Estimation of Remaining Useful Life (RUL) of Bearing. Advanced Engineering Informatics, 58, Article 102206. https://doi.org/10.1016/j.aei.2023.102206
[30]  Nusrat, I. and Jang, S. (2018) A Comparison of Regularization Techniques in Deep Neural Networks. Symmetry, 10, Article 648. https://doi.org/10.3390/sym10110648
[31]  Sat-tler, F., Wiedemann, S., Muller, K. and Samek, W. (2020) Robust and Commu-nication-Efficient Federated Learning from Non-I.I.D. Data. IEEE Transactions on Neural Networks and Learning Systems, 31, 3400-3413. https://doi.org/10.1109/tnnls.2019.2944481
[32]  Al-Zyoud, I., Laamarti, F., Ma, X., Tobón, D. and El Saddik, A. (2022) Towards a Machine Learning-Based Digital Twin for Non-Invasive Human Bio-Signal Fusion. Sensors, 22, Article 9747. https://doi.org/10.3390/s22249747
[33]  Hassan, E., Shams, M.Y., Hikal, N.A. and Elmougy, S. (2022) The Effect of Choosing Optimizer Algorithms to Improve Computer Vision Tasks: A Comparative Study. Multimedia Tools and Applications, 82, 16591-16633. https://doi.org/10.1007/s11042-022-13820-0
[34]  Benyamin, G. and Crow-ley, M. (2019) The Theory behind Overfitting, cross Validation, Regularization, Bagging, and Boosting: Tutorial.
[35]  Leslie, R., Wong, E. and Kolter, Z. (2020) Overfitting in Adversarially Robust Deep Learning. International Conference on Machine Learning, Austria, 13-18 July 2020, 8093-8104.
[36]  Cieslak, D.A., Chawla, N.V. and Striegel, A. (2006) Combating Imbalance in Network Intrusion Datasets. 2006 IEEE International Conference on Granular Computing, Atlanta, 10-12 May 2006, 732-737. https://doi.org/10.1109/grc.2006.1635905
[37]  Smith, L.N. (2018) A Disci-plined Approach to Neural Network Hyper-Parameters: Part 1: Learning Rate, Batch Size, Momentum, and Weight Decay.
[38]  Ellis, A.W. and Lambon Ralph, M.A. (2000) Age of Acquisition Effects in Adult Lexical Processing Reflect Loss of Plasticity in Maturing Systems: Insights from Connectionist Networks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 1103-1123. https://doi.org/10.1037//0278-7393.26.5.1103
[39]  Sepehr, A., Go-mis-Bellmunt, O. and Pouresmaeil, E. (2022) Employing Machine Learning for Enhancing Transient Stability of Power Synchronization Control during Fault Conditions in Weak Grids. IEEE Transactions on Smart Grid, 13, 2121-2131. https://doi.org/10.1109/tsg.2022.3148590
[40]  Hofer, I.S., Lee, C., Gabel, E., Baldi, P. and Cannesson, M. (2020) Development and Validation of a Deep Neural Network Model to Predict Postoperative Mortality, Acute Kidney Injury, and Reintubation Using a Single Feature Set. npj Digital Medicine, 3, Article No. 58. https://doi.org/10.1038/s41746-020-0248-0
[41]  Wan, A., Chang, Q., AL-Bukhaiti, K. and He, J. (2023) Short-Term Power Load Forecasting for Com-bined Heat and Power Using CNN-LSTM Enhanced by Attention Mechanism. Energy, 282, Article 128274. https://doi.org/10.1016/j.energy.2023.128274
[42]  Gigerenzer, G. and Todd, P.M. (1999) Fast and Frugal Heuristics: The Adaptive Toolbox. In: Simple Heuristics That Make Us Smart, Oxford University Press, 3-34.
[43]  O’Sullivan, R., Inouye, S.K. and Meagher, D. (2014) Delirium and Depression: In-ter-Relationship and Clinical Overlap in Elderly People. The Lancet Psychiatry, 1, 303-311. https://doi.org/10.1016/s2215-0366(14)70281-0
[44]  Old-ham, M.A. (2022) Delirium Disorder: Unity in Diversity. General Hospital Psy-chiatry, 74, 32-38. https://doi.org/10.1016/j.genhosppsych.2021.11.007
[45]  Boehm, L.M., Jones, A.C., Selim, A.A., Virdun, C., Garrard, C.F., Walden, R.L., et al. (2021) De-lirium-Related Distress in the ICU: A Qualitative Meta-Synthesis of Patient and Family Perspectives and Experiences. International Journal of Nursing Studies, 122, Article 104030. https://doi.org/10.1016/j.ijnurstu.2021.104030
[46]  Niso, G., Krol, L.R., Combrisson, E., Dubarry, A.S., Elliott, M.A., François, C., et al. (2022) Good Sci-entific Practice in EEG and MEG Research: Progress and Perspectives. Neu-roImage, 257, Article 119056. https://doi.org/10.1016/j.neuroimage.2022.119056
[47]  Lucchiari, C. and Pravettoni, G. (2011) Cognitive Balanced Model: A Conceptual Scheme of Diag-nostic Decision Making. Journal of Evaluation in Clinical Practice, 18, 82-88. https://doi.org/10.1111/j.1365-2753.2011.01771.x
[48]  Stanley, D.J. and Spence, J.R. (2014) Expectations for Replications. Perspectives on Psychological Science, 9, 305-318. https://doi.org/10.1177/1745691614528518
[49]  Crisan, S. (2016) A Novel Perspective on Hand Vein Patterns for Biometric Recognition: Problems, Chal-lenges, and Implementations. In: Signal Processing for Security Technologies, Springer, 21-49. https://doi.org/10.1007/978-3-319-47301-7_2
[50]  Anto-nio, G., Kapoor, A., and Pal, S. (2019) Deep Learning with TensorFlow 2 and Keras: Regression, ConvNets, GANs, RNNs, NLP, and More with TensorFlow 2 and the Keras API. Packt Publishing Ltd.
[51]  Boominathan, V., Robinson, J.T., Waller, L. and Veeraraghavan, A. (2021) Recent Advances in Lensless Imaging. Optica, 9, 1-16. https://doi.org/10.1364/optica.431361
[52]  Kim, Y.K., Seo, W., Lee, S.J., Koo, J.H., Kim, G.C., Song, H.S., et al. (2024) Early Prediction of Cardiac Arrest in the Intensive Care Unit Using Explainable Machine Learning: Retrospective Study. Journal of Medical Internet Research, 26, e62890. https://doi.org/10.2196/62890
[53]  Huang, Z., Huang, S., Li, C., et al. (2020) Artificial Intelligence Assisted Early Warning System for Acute Kidney Injury Driven by Multi-Center ICU Database.
[54]  Liu, P., Li, S., Zheng, T., Wu, J., Fan, Y., Liu, X., et al. (2023) Subphenotyping Heterogeneous Patients with Chronic Critical Illness to Guide Individualised Fluid Balance Treatment Using Machine Learning: A Retrospective Cohort Study. E Clinical Medicine, 59, Article 101970. https://doi.org/10.1016/j.eclinm.2023.101970
[55]  Cutillo, C.M., Sharma, K.R., Foschini, L., Kundu, S., Mackintosh, M., Mandl, K.D., et al. (2020) Machine Intelligence in Healthcare—Perspectives on Trustworthiness, Explain-ability, Usability, and Transparency. npj Digital Medicine, 3, Article No. 47. https://doi.org/10.1038/s41746-020-0254-2
[56]  Rahman, H., Kazi, R.H., et al. (2024) Improving Collaborative Interactions between Humans and Artificial Intelligence to Achieve Optimal Patient Outcomes in the Healthcare Indus-try.
[57]  Kalusivalingam, A.K., Sharma, A., Patel, N. and Singh, V. (2012) En-hancing ICU Monitoring with Predictive Analytics Using Random Forests and Long Short-Term Memory Networks. International Journal of AI and ML, 1, 1-26.
[58]  Filippis, R.d. and Foysal, A.A. (2024) Securing Predictive Psycholog-ical Assessments: The Synergy of Blockchain Technology and Artificial Intelli-gence. Open Access Library, 11, 1-23. https://doi.org/10.4236/oalib.1112378
[59]  Filippis, R.d. and Foysal, A.A. (2024) Harnessing the Power of Artificial Intelligence in Neuromuscular Dis-ease Rehabilitation: A Comprehensive Review and Algorithmic Approach. Ad-vances in Bioscience and Biotechnology, 15, 289-309. https://doi.org/10.4236/abb.2024.155018
[60]  El-Rashidy, N., Tarek, Z., Elshewey, A.M. and Shams, M.Y. (2024) Multitask Multilayer-Prediction Model for Predicting Mechanical Ventilation and the Associated Mortality Rate. Neural Computing and Applications, 2024, 1-23. https://doi.org/10.1007/s00521-024-10468-9
[61]  Filippis, R.D. and Foysal, A.A. (2024) Chatbots in Psychology: Revolutionizing Clinical Support and Men-tal Health Care. Voice of the Publisher, 10, 298-321. https://doi.org/10.4236/vp.2024.103025
[62]  de Filippis, R., Al Foysal, A., Rocco, V., et al. (2024) The Risk Perspective of AI in Healthcare: GDPR and GEL-SI Framework (Governance, Ethical, Legal and Social Implications) and the New European AI Act. Italian Journal of Psychiatry, 10, 12-16.
[63]  Mehdizavareh, H., Khan, A. and Cichosz, S.L. (2024) Enhancing Glucose Level Prediction of ICU Patients through Irregular Time-Series Analysis and Integrated Representa-tion.
[64]  Bhattacharyya, A., Sheikhalishahi, S., Torbic, H., Yeung, W., Wang, T., Birst, J., et al. (2022) Delirium Prediction in the ICU: Designing a Screening Tool for Preventive Interventions. JAMIA Open, 5, ooac048. https://doi.org/10.1093/jamiaopen/ooac048
[65]  Long, D.A. and Fink, E.L. (2021) Transitions from Short to Long-Term Outcomes in Pediatric Critical Care: Considerations for Clinical Practice. Translational Pediatrics, 10, 2858-2874. https://doi.org/10.21037/tp-21-61
[66]  Black, P., Boore, J.R.P. and Parahoo, K. (2011) The Effect of Nurse-Facilitated Family Participation in the Psychological Care of the Critically Ill Patient. Journal of Advanced Nursing, 67, 1091-1101. https://doi.org/10.1111/j.1365-2648.2010.05558.x
[67]  Boehnlein, A., Diefenthaler, M., Sato, N., Schram, M., Ziegler, V., Fanelli, C., et al. (2022) Col-loquium: Machine Learning in Nuclear Physics. Reviews of Modern Physics, 94, Article 031003. https://doi.org/10.1103/revmodphys.94.031003
[68]  Tieges, Z., Maclullich, A.M.J., Anand, A., Brookes, C., Cassarino, M., O’connor, M., et al. (2020) Diag-nostic Accuracy of the 4AT for Delirium Detection in Older Adults: Systematic Review and Meta-Analysis. Age and Ageing, 50, 733-743. https://doi.org/10.1093/ageing/afaa224
[69]  Haverkate, M.R., Xie, M., Mamun, A.A., et al. (2022) Impact of the SARS-CoV-2 Pandemic on Overall and Diagnosis-Specific Antibiotic Prescription Rates in Long-Term-Care Facilities in British Columbia, Canada. https://utppublishing.com/doi/pdf/10.3138/jammi.7.s1.abst
[70]  Goyal, M. and Mahmoud, Q.H. (2024) A Systematic Review of Synthetic Data Generation Techniques Using Generative AI. Electronics, 13, Article 3509. https://doi.org/10.3390/electronics13173509
[71]  Murtaza, H., Ahmed, M., Khan, N.F., Murtaza, G., Zafar, S. and Bano, A. (2023) Synthetic Data Genera-tion: State of the Art in Health Care Domain. Computer Science Review, 48, Ar-ticle 100546. https://doi.org/10.1016/j.cosrev.2023.100546
[72]  Major, V.J., Jethani, N. and Aphinyanaphongs, Y. (2020) Estimating Real-World Perfor-mance of a Predictive Model: A Case-Study in Predicting Mortality. JAMIA Open, 3, 243-251. https://doi.org/10.1093/jamiaopen/ooaa008

Full-Text


Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133