全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

A Hybrid Machine Learning Framework for Early Diabetes Prediction in Sierra Leone Using Feature Selection and Soft-Voting Ensemble

DOI: 10.4236/jsea.2026.192002, PP. 7-24

Keywords: Diabetes Prediction, Hybrid Ensemble, Soft Voting, Feature Selection, XGBoost, Sierra Leone

Full-Text   Cite this paper   Add to My Lib

Abstract:

This paper proposes a hybrid machine learning framework for early diabetes prediction tailored to Sierra Leone, where locally representative datasets are scarce. The framework integrates Random Forest (RF), Logistic Regression (LR), and Extreme Gradient Boosting (XGBoost) into a probability-based soft-voting ensemble that prioritizes sensitivity (recall) for screening. Experiments were conducted under two conditions: 1) using all available features and 2) after feature selection based on RF importance, retaining six clinically meaningful predictors (Glucose, Diabetes Pedigree Function, Skin Thickness, Age, Body Mass Index, and Insulin). Evaluation employed Accuracy, Precision, Recall, F1-score, ROC-AUC, and confusion-matrix analysis with a screening-oriented decision threshold. Before feature selection, the hybrid model achieved a Recall of 0.8571 and an ROC-AUC of 0.8610, reducing false negatives compared with individual classifiers. After feature selection, performance remained competitive while improving interpretability and deployment feasibility. Benchmark validation on the Pima Indians Diabetes dataset further supported the robustness of the approach. The proposed hybrid framework provides a practical, sensitivity-focused decision-support tool for early diabetes screening in low-resource clinical environments.

References

[1]  Magliano, D.J., Boyko, E.J., IDF Diabetes Atlas, et al. (2021) Covid-19 and Diabetes. In IDF Diabetes Atlas [Internet]. 10th Edition, International Diabetes Federation.
[2]  World Health Organization, et al. (2020) World Health Statistics 2020.
[3]  Atun, R., Davies, J.I., Gale, E.A.M., et al. (2017) Diabetes in Sub-Saharan Africa: From Clinical Care to Health Policy. The Lancet Diabetes & Endocrinology, 5, 622-667.
[4]  World Health Organization, et al. (2017) Who Country Cooperation Strategy 2017-2021: Sierra Leone.
[5]  Kaviyaadharshani, D., Nivedhidha, M., Jeyarohini, R., Rani, J.L.E., Ramkumar, M.P. and Selvan, G.S.R.E. (2024) Diagnosing Diabetes Using Machine Learning-Based Predictive Models. Procedia Computer Science, 233, 288-294.
https://doi.org/10.1016/j.procs.2024.03.218
[6]  Dutta, A., Hasan, M.K., Ahmad, M., Awal, M.A., Islam, M.A., Masud, M., et al. (2022) Early Prediction of Diabetes Using an Ensemble of Machine Learning Models. International Journal of Environmental Research and Public Health, 19, Article No. 12378.
https://doi.org/10.3390/ijerph191912378
[7]  He, H.B. and Garcia, E.A. (2009) Learning from Imbalanced Data. IEEE Transactions on Knowledge and Data Engineering, 21, 1263-1284.
https://doi.org/10.1109/tkde.2008.239
[8]  Bachmann, K.N. and Wang, T.J. (2017) Biomarkers of Cardiovascular Disease: Contributions to Risk Prediction in Individuals with Diabetes. Diabetologia, 61, 987-995.
https://doi.org/10.1007/s00125-017-4442-9
[9]  Hosmer, D.W., Lemeshow, S. and Sturdivant, R.X. (2013) Applied Logistic Regression. Wiley.
https://doi.org/10.1002/9781118548387
[10]  Breiman, L. (2001) Random Forests. Machine Learning, 45, 5-32.
https://doi.org/10.1023/a:1010933404324
[11]  Chen, T.Q. (2016) Xgboost: A Scalable Tree Boosting System. Cornell University.
[12]  Fawcett, T. (2006) An Introduction to ROC Analysis. Pattern Recognition Letters, 27, 861-874.
https://doi.org/10.1016/j.patrec.2005.10.010
[13]  UCI Machine Learning (2016) Pima Indians Diabetes Database.
https://kaggle.com/uciml/pima-indians-diabetes-database
[14]  Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C. and Johannes, R.S. (1988) Using the ADAP Learning Algorithm to Forecast the Onset of Diabetes Mellitus. Proceedings of the Annual Symposium on Computer Application in Medical Care, Washington DC, 6-9 November 1988, 261.
[15]  Dua, D. and Graff, C. (2019) UCI Machine Learning Repository. Irvine, CA: University of California, School of Information and Computer Science. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1, 1-29.
http://archive.ics.uci.edu/ml
[16]  Chawla, N.V., Bowyer, K.W., Hall, L.O. and Kegelmeyer, W.P. (2002) SMOTE: Synthetic Minority Over-Sampling Technique. Journal of Artificial Intelligence Research, 16, 321-357.
https://doi.org/10.1613/jair.953
[17]  Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., et al. (2011) Scikit-Learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825-2830.
[18]  Ribeiro, M.T., Singh, S. and Guestrin, C. (2016) Why Should I Trust You? Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 13-17 August 2016, 1135-1144.
https://doi.org/10.1145/2939672.2939778
[19]  Lundberg, S.M. and Lee, S.-I. (2017) A Unified Approach to Interpreting Model Predictions. NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, 4-9 December 2017, 4768-4777.
[20]  Collins, G.S., Reitsma, J.B., Altman, D.G. and Moons, K.G.M. (2015) Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement. British Journal of Surgery, 102, 148-158.
https://doi.org/10.1002/bjs.9736
[21]  Dietterich, T.G. (2000) Ensemble Methods in Machine Learning. In: Kittler, J. and Roli, F., Eds., International Workshop on Multiple Classifier Systems, Springer, 1-15.
https://doi.org/10.1007/3-540-45014-9_1
[22]  Kuncheva, L.I. (2014) Combining Pattern Classifiers: Methods and Algorithms. Wiley.
https://doi.org/10.1002/9781118914564
[23]  Alberti, K.G.M.M. and Zimmet, P.Z. (1998) Definition, Diagnosis and Classification of Diabetes Mellitus and Its Complications. Part 1: Diagnosis and Classification of Diabetes Mellitus. Provisional Report of a WHO Consultation. Diabetic Medicine, 15, 539-553.
https://doi.org/10.1002/(sici)1096-9136(199807)15:7<539::aid-dia668>3.0.co;2-s
[24]  Omar, R. (2010) Clinical Prediction Models: A Practical Approach to Development, Validation and Updating by Steyerberg, E.W. Biometrics, 66, 661-662.
https://doi.org/10.1111/j.1541-0420.2010.01431.x
[25]  Kohavi, R., et al. (1995) A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. IJCAI, Volume 14, 1137-1145.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133