Background: Intracranial suppurative infections (ISIs) are conventionally classified by anatomical compartment—brain abscess, subdural empyema, extradural empyema—a taxonomy that captures neither the heterogeneity of routes of infection nor the diversity of care pathways. No previous study has examined whether unsupervised learning can redefine clinically meaningful phenotypes of ISI beyond conventional anatomical categories, and none has done so in an African cohort. Methods: We analysed 150 consecutive observations (148 patients) of ISI managed at Bouaké University Hospital, C?te d’Ivoire, between 2016 and 2026. In the primary analysis, nineteen pre-therapeutic variables spanning host factors, symptom-to-admission delay, neurological severity, grouped portal of entry, lesion type and lesion burden were entered into a factor analysis of mixed data (FAMD); the origin of the suppuration, almost collinear with the portal of entry, was removed, and the specification including both was kept as a sensitivity analysis. Phenotypes were derived by K-means clustering on the retained factor coordinates, with Ward clustering on the same Euclidean coordinates and partitioning around medoids (PAM) on Gower distances as concordance checks. The reproducibility of the whole pipeline was assessed by repeated nested cross-validation, imputation, FAMD and K-means being re-estimated in every training set. In-hospital mortality and functional status were analysed as separate outcomes, and the incremental prognostic value of phenotype beyond GCS and age was assessed with optimism correction by bootstrap (1000 replicates). Results: In the primary non-redundant specification, a four-class solution was retained (silhouette 0.296). Its concordance with the dual-coded partition was moderate (adjusted Rand index [ARI] 0.325), and the frontal-interhemispheric sinogenic subdural empyema phenotype was the most robust (28 of 33 observations recovered). PAM on Gower distances identified four groups of 48, 36, 34 and 32 observations (silhouette 0.312; ARI with FAMD-K-means 0.671). Out-of-sample agreement of the complete pipeline was 87.6% ± 4.8% (mean ARI 0.79 ± 0.09). The dual-coded specification, used for detailed characterisation, separated community-acquired brain abscess of ENT-dental or cryptogenic origin (n = 54), delayed post-traumatic suppuration (n = 33; median delay 29 days), sinogenic subdural empyema (n = 33; craniotomy 91%, external ventricular drainage 24%) and post-operative suppuration (n =
References
[1]
Brouwer, M.C., Tunkel, A.R., McKhann, G.M. and van de Beek, D. (2014) Brain Abscess. New England Journal of Medicine, 371, 447-456. https://doi.org/10.1056/nejmra1301635
Brouwer, M.C. and van de Beek, D. (2017) Epidemiology, Diagnosis, and Treatment of Brain Abscesses. Current Opinion in Infectious Diseases, 30, 129-134. https://doi.org/10.1097/qco.0000000000000334
[4]
Patel, K. and Clifford, D.B. (2014) Bacterial Brain Abscess. The Neurohospitalist, 4, 196-204. https://doi.org/10.1177/1941874414540684
[5]
Bodilsen, J., Dalager-Pedersen, M., van de Beek, D., Brouwer, M.C. and Nielsen, H. (2020) Incidence and Mortality of Brain Abscess in Denmark: A Nationwide Population-Based Study. Clinical Microbiology and Infection, 26, 95-100. https://doi.org/10.1016/j.cmi.2019.05.016
[6]
Brouwer, M.C., Coutinho, J.M. and van de Beek, D. (2014) Clinical Characteristics and Outcome of Brain Abscess: Systematic Review and Meta-Analysis. Neurology, 82, 806-813. https://doi.org/10.1212/wnl.0000000000000172
[7]
Bodilsen, J., Duerlund, L.S., Mariager, T., Brandt, C.T., Petersen, P.T., Larsen, L., et al. (2022) Clinical Features and Prognostic Factors in Adults with Brain Abscess. Brain, 146, 1637-1647. https://doi.org/10.1093/brain/awac312
[8]
Omland, L.H., Nielsen, H. and Bodilsen, J. (2024) Update and Approach to Patients with Brain Abscess. Current Opinion in Infectious Diseases, 37, 211-219. https://doi.org/10.1097/qco.0000000000001014
[9]
Bodilsen, J., D’Alessandris, Q.G., Humphreys, H., Iro, M.A., Klein, M., Last, K., et al. (2024) European Society of Clinical Microbiology and Infectious Diseases Guidelines on Diagnosis and Treatment of Brain Abscess in Children and Adults. Clinical Microbiology and Infection, 30, 66-89. https://doi.org/10.1016/j.cmi.2023.08.016
[10]
Meara, J.G., Leather, A.J.M., Hagander, L., Alkire, B.C., Alonso, N., Ameh, E.A., et al. (2015) Global Surgery 2030: Evidence and Solutions for Achieving Health, Welfare, and Economic Development. The Lancet, 386, 569-624. https://doi.org/10.1016/s0140-6736(15)60160-x
[11]
Dewan, M.C., Rattani, A., Fieggen, G., Arraez, M.A., Servadei, F., Boop, F.A., et al. (2019) Global Neurosurgery: The Current Capacity and Deficit in the Provision of Essential Neurosurgical Care. Executive Summary of the Global Neurosurgery Initiative at the Program in Global Surgery and Social Change. Journal of Neurosurgery, 130, 1055-1064. https://doi.org/10.3171/2017.11.jns171500
[12]
Corley, J., Lepard, J., Barthélemy, E., Ashby, J.L. and Park, K.B. (2019) Essential Neurosurgical Workforce Needed to Address Neurotrauma in Low-and Middle-Income Countries. World Neurosurgery, 123, 295-299. https://doi.org/10.1016/j.wneu.2018.12.042
[13]
Park, K.B., Johnson, W.D. and Dempsey, R.J. (2016) Global Neurosurgery: The Unmet Need. World Neurosurgery, 88, 32-35. https://doi.org/10.1016/j.wneu.2015.12.048
[14]
World Health Organization (2015) Strengthening Emergency and Essential Surgical Care and Anaesthesia as a Component of Universal Health Coverage (Resolution WHA68.15). World Health Organization.
[15]
Nathoo, N., Narotam, P.K., Nadvi, S. and van Dellen, J.R. (2012) Taming an Old Enemy: A Profile of Intracranial Suppuration. World Neurosurgery, 77, 484-490. https://doi.org/10.1016/j.wneu.2011.04.023
[16]
Djientcheu, V.P., Mouafo, T.F., Esiene, A., Kamga, Y.N., Nguefack, S., Bello, F., et al. (2012) Intracranial Suppurations in the African Child: A Severe but Preventable Complication. Child’s Nervous System, 29, 119-123. https://doi.org/10.1007/s00381-012-1930-6
[17]
Miranda, H.A., Castellar Leones, S.M., Elzain, M.A. and Moscote-Salazar, L.R. (2013) Brain Abscess: Current Management. Journal of Neurosciences in Rural Practice, 04, S67-S81. https://doi.org/10.4103/0976-3147.116472
[18]
Anwary, M.A. (2015) Intracranial Suppuration: Review of an 8-Year Experience at Umtata General Hospital and Nelson Mandela Academic Hospital, Eastern Cape, South Africa. South African Medical Journal, 105, 584-588. https://doi.org/10.7196/samjnew.7882
[19]
Borni, M., Znazen, M., Kolsi, F. and Zaher Boudawara, M. (2022) Clinico-Radiological Assessment and Therapeutic Management of Intracranial Suppurations: Bicentric Series of 43 Cases with Literature Review. Interdisciplinary Neurosurgery, 27, Article ID: 101393. https://doi.org/10.1016/j.inat.2021.101393
[20]
Nathoo, N., Nadvi, S.S., Narotam, P.K. and van Dellen, J.R. (2011) Brain Abscess: Management and Outcome Analysis of a Computed Tomography Era Experience with 973 Patients. World Neurosurgery, 75, 716-726. https://doi.org/10.1016/j.wneu.2010.11.043
[21]
Sonneville, R., Ruimy, R., Benzonana, N., Riffaud, L., Carsin, A., Tadié, J.M., et al. (2017) An Update on Bacterial Brain Abscess in Immunocompetent Patients. Clinical Microbiology and Infection, 23, 614-620. https://doi.org/10.1016/j.cmi.2017.05.004
[22]
Menon, S., Bharadwaj, R., Chowdhary, A., Kaundinya, D.V. and Palande, D.A. (2008) Current Epidemiology of Intracranial Abscesses: A Prospective 5 Year Study. Journal of Medical Microbiology, 57, 1259-1268. https://doi.org/10.1099/jmm.0.47814-0
[23]
Nathoo, N., Nadvi, S.S., van Dellen, J.R. and Gouws, E. (1999) Intracranial Subdural Empyemas in the Era of Computed Tomography: A Review of 699 Cases. Neurosurgery, 44, 529-535. https://doi.org/10.1097/00006123-199903000-00055
[24]
Nathoo, N., Nadvi, S.S., Gouws, E. and van Dellen, J.R. (2001) Craniotomy Improves Outcomes for Cranial Subdural Empyemas: Computed Tomography-Era Experience with 699 Patients. Neurosurgery, 49, 872-878. https://doi.org/10.1227/00006123-200110000-00017
[25]
Chikani, M., Mezue, W., Okorie, E., Mbachu, C., Ndubisi, C. and Chikani, U. (2017) Subdural Empyema: Clinical Presentations and Management Options for an Uncommon Neurosurgical Emergency in a Developing Country. Nigerian Journal of Clinical Practice, 20, 1221-1225. https://doi.org/10.4103/njcp.njcp_340_16
[26]
Jolayemi, E.O., Bankole, O.B., Ojo, O.A., Bamigboye, B., Adebayo, B.O., Arekhandia, B.J., et al. (2022) Contemporary Management of Intracranial Subdural Empyema. Journal of West African College of Surgeons, 12, 56-63. https://doi.org/10.4103/jwas.jwas_127_22
[27]
Hlavin, M.L., Kaminski, H.J., Fenstermaker, R.A. and White, R.J. (1994) Intracranial Suppuration: A Modern Decade of Postoperative Subdural Empyema and Epidural Abscess. Neurosurgery, 34, 974-981. https://doi.org/10.1227/00006123-199406000-00004
[28]
Tseng, J.H. and Tseng, M.Y. (2006) Brain Abscess in 142 Patients: Factors Influencing Outcome and Mortality. Surgical Neurology, 65, 557-562. https://doi.org/10.1016/j.surneu.2005.09.029
[29]
Loftus, T.J., Shickel, B., Balch, J.A., Tighe, P.J., Abbott, K.L., Fazzone, B., et al. (2022) Phenotype Clustering in Health Care: A Narrative Review for Clinicians. Frontiers in Artificial Intelligence, 5, Article 842306. https://doi.org/10.3389/frai.2022.842306
[30]
Seymour, C.W., Kennedy, J.N., Wang, S., Chang, C.H., Elliott, C.F., Xu, Z., et al. (2019) Derivation, Validation, and Potential Treatment Implications of Novel Clinical Phenotypes for Sepsis. JAMA, 321, 2003-2017. https://doi.org/10.1001/jama.2019.5791
[31]
Calfee, C.S., Delucchi, K., Parsons, P.E., Thompson, B.T., Ware, L.B. and Matthay, M.A. (2014) Subphenotypes in Acute Respiratory Distress Syndrome: Latent Class Analysis of Data from Two Randomised Controlled Trials. The Lancet Respiratory Medicine, 2, 611-620. https://doi.org/10.1016/s2213-2600(14)70097-9
[32]
Famous, K.R., Delucchi, K., Ware, L.B., Kangelaris, K.N., Liu, K.D., Thompson, B.T., et al. (2017) Acute Respiratory Distress Syndrome Subphenotypes Respond Differently to Randomized Fluid Management Strategy. American Journal of Respiratory and Critical Care Medicine, 195, 331-338. https://doi.org/10.1164/rccm.201603-0645oc
[33]
Ahlqvist, E., Storm, P., K?r?j?m?ki, A., Martinell, M., Dorkhan, M., Carlsson, A., et al. (2018) Novel Subgroups of Adult-Onset Diabetes and Their Association with Outcomes: A Data-Driven Cluster Analysis of Six Variables. The Lancet Diabetes & Endocrinology, 6, 361-369. https://doi.org/10.1016/s2213-8587(18)30051-2
[34]
L?tvall, J., Akdis, C.A., Bacharier, L.B., Bjermer, L., Casale, T.B., Custovic, A., et al. (2011) Asthma Endotypes: A New Approach to Classification of Disease Entities within the Asthma Syndrome. Journal of Allergy and Clinical Immunology, 127, 355-360. https://doi.org/10.1016/j.jaci.2010.11.037
[35]
Shah, S.J., Katz, D.H., Selvaraj, S., Burke, M.A., Yancy, C.W., Gheorghiade, M., et al. (2015) Phenomapping for Novel Classification of Heart Failure with Preserved Ejection Fraction. Circulation, 131, 269-279. https://doi.org/10.1161/circulationaha.114.010637
[36]
Kaufman, L. and Rousseeuw, P.J. (1990) Finding Groups in Data: An Introduction to Cluster Analysis. Wiley. https://doi.org/10.1002/9780470316801
[37]
Hastie, T., Tibshirani, R. and Friedman, J. (2009) The Elements of Statistical Learning. Springer. https://doi.org/10.1007/978-0-387-84858-7
[38]
Riley, R.D., Ensor, J., Snell, K.I.E., Harrell, F.E., Martin, G.P., Reitsma, J.B., et al. (2020) Calculating the Sample Size Required for Developing a Clinical Prediction Model. BMJ, 368, m441. https://doi.org/10.1136/bmj.m441
[39]
von Elm, E., Altman, D.G., Egger, M., Pocock, S.J., G?tzsche, P.C. and Vandenbroucke, J.P. (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. The Lancet, 370, 1453-1457. https://doi.org/10.1016/s0140-6736(07)61602-x
[40]
Vandenbroucke, J.P., von Elm, E., Altman, D.G., G?tzsche, P.C., Mulrow, C.D., Pocock, S.J., et al. (2007) Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. PLOS Medicine, 4, e297. https://doi.org/10.1371/journal.pmed.0040297
[41]
Collins, G.S., Moons, K.G.M., Dhiman, P., Riley, R.D., Beam, A.L., Van Calster, B., et al. (2024) TRIPOD + AI Statement: Updated Guidance for Reporting Clinical Prediction Models That Use Regression or Machine Learning Methods. BMJ, 385, e078378. https://doi.org/10.1136/bmj-2023-078378
[42]
Moons, K.G.M., Damen, J.A.A., Kaul, T., Hooft, L., Andaur Navarro, C., Dhiman, P., et al. (2025) PROBAST + AI: An Updated Quality, Risk of Bias, and Applicability Assessment Tool for Prediction Models Using Regression or Artificial Intelligence Methods. BMJ, 388, e082505. https://doi.org/10.1136/bmj-2024-082505
[43]
Lekadir, K., Frangi, A.F., Porras, A.R., FUTURE-AI Consortium, et al. (2025) FU-TURE-AI: International Consensus Guideline for Trustworthy and Deployable Artificial Intelligence in Healthcare. BMJ, 388, e081554.
[44]
Norgeot, B., Quer, G., Beaulieu-Jones, B.K., Torkamani, A., Dias, R., Gianfrancesco, M., et al. (2020) Minimum Information about Clinical Artificial Intelligence Modeling: The MI-CLAIM Checklist. Nature Medicine, 26, 1320-1324. https://doi.org/10.1038/s41591-020-1041-y
[45]
Vasey, B., Nagendran, M., Campbell, B., Clifton, D.A., Collins, G.S., Denaxas, S., et al. (2022) Reporting Guideline for the Early-Stage Clinical Evaluation of Decision Support Systems Driven by Artificial Intelligence: Decide-AI. Nature Medicine, 28, 924-933. https://doi.org/10.1038/s41591-022-01772-9
[46]
Liu, X., Cruz Rivera, S., Moher, D., Calvert, M.J., Denniston, A.K., Chan, A., et al. (2020) Reporting Guidelines for Clinical Trial Reports for Interventions Involving Artificial Intelligence: The CONSORT-AI Extension. Nature Medicine, 26, 1364-1374. https://doi.org/10.1038/s41591-020-1034-x
[47]
Cruz Rivera, S., Liu, X., Chan, A., Denniston, A.K., Calvert, M.J., Darzi, A., et al. (2020) Guidelines for Clinical Trial Protocols for Interventions Involving Artificial Intelligence: The SPIRIT-AI Extension. Nature Medicine, 26, 1351-1363. https://doi.org/10.1038/s41591-020-1037-7
[48]
Buuren, S.V. and Groothuis-Oudshoorn, K. (2011) Mice: Multivariate Imputation by Chained Equations in R. Journal of Statistical Software, 45, 1-67. https://doi.org/10.18637/jss.v045.i03
[49]
Stekhoven, D.J. and Bühlmann, P. (2011) MissForest—Non-Parametric Missing Value Imputation for Mixed-Type Data. Bioinformatics, 28, 112-118. https://doi.org/10.1093/bioinformatics/btr597
[50]
Sterne, J.A.C., White, I.R., Carlin, J.B., Spratt, M., Royston, P., Kenward, M.G., et al. (2009) Multiple Imputation for Missing Data in Epidemiological and Clinical Research: Potential and Pitfalls. BMJ, 338, b2393. https://doi.org/10.1136/bmj.b2393
[51]
Pagès, J. (2004) Analyse Factorielle de données Mixtes. Revue de Statistique Appliquée, 52, 93-111.
[52]
Ward, J.H. (1963) Hierarchical Grouping to Optimize an Objective Function. Journal of the American Statistical Association, 58, 236-244. https://doi.org/10.1080/01621459.1963.10500845
[53]
Kaufman, L. and Rousseeuw, P.J. (1987) Statistical Data Analysis Based on the L1-Norm and Related Methods. Proceedings of the First International Conference on Statistical Data Analysis Based on the L1-Norm and Related Methods, Neuchatel, 31 August-4 September 1987, 405-416. https://ci.nii.ac.jp/ncid/BA01083164
[54]
Gower, J.C. (1971) A General Coefficient of Similarity and Some of Its Properties. Biometrics, 27, 857-871. https://doi.org/10.2307/2528823
[55]
Hubert, L. and Arabie, P. (1985) Comparing Partitions. Journal of Classification, 2, 193-218. https://doi.org/10.1007/bf01908075
[56]
Rousseeuw, P.J. (1987) Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis. Journal of Computational and Applied Mathematics, 20, 53-65. https://doi.org/10.1016/0377-0427(87)90125-7
[57]
Caliński, T. and Harabasz, J. (1974) A Dendrite Method for Cluster Analysis. Communications in Statistics, 3, 1-27. https://doi.org/10.1080/03610927408827101
[58]
Davies, D.L. and Bouldin, D.W. (1979) A Cluster Separation Measure. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1, 224-227. https://doi.org/10.1109/tpami.1979.4766909
[59]
Tibshirani, R., Walther, G. and Hastie, T. (2001) Estimating the Number of Clusters in a Data Set via the Gap Statistic. Journal of the Royal Statistical Society Series B: Statistical Methodology, 63, 411-423. https://doi.org/10.1111/1467-9868.00293
[60]
Hennig, C. (2007) Cluster-Wise Assessment of Cluster Stability. Computational Statistics & Data Analysis, 52, 258-271. https://doi.org/10.1016/j.csda.2006.11.025
[61]
Breiman, L. (2001) Random Forests. Machine Learning, 45, 5-32. https://doi.org/10.1023/a:1010933404324
[62]
Brier, G.W. (1950) Verification of Forecasts Expressed in Terms of Probability. Monthly Weather Review, 78, 1-3. https://doi.org/10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
[63]
McInnes, L., Healy, J. and Melville, J. (2018) UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv: 1802.03426.
[64]
Firth, D. (1993) Bias Reduction of Maximum Likelihood Estimates. Biometrika, 80, 27-38. https://doi.org/10.1093/biomet/80.1.27
[65]
Heinze, G. and Schemper, M. (2002) A Solution to the Problem of Separation in Logistic Regression. Statistics in Medicine, 21, 2409-2419. https://doi.org/10.1002/sim.1047
[66]
Harrell, F.E., Lee, K.L. and Mark, D.B. (1996) Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors. Statistics in Medicine, 15, 361-387. https://doi.org/10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
[67]
Feng, J., Zhang, B., Lu, W., Liu, H., Liu, Y., Zou, Y., et al. (2026) Streptococcus Anginosus Group Brain Abscesses and Subdural Empyemas: Exploratory Compartment-Specific Phenotypes and Discharge Outcomes in a Single-Center Retrospective Cohort Study. BMC Infectious Diseases, 26, Article No. 1560. https://doi.org/10.1186/s12879-026-13998-w
[68]
Helweg-Larsen, J., Astradsson, A., Richhall, H., Erdal, J., Laursen, A. and Brennum, J. (2012) Pyogenic Brain Abscess, a 15 Year Survey. BMC Infectious Diseases, 12, Article No. 332. https://doi.org/10.1186/1471-2334-12-332
[69]
Xiao, F., Tseng, M., Teng, L., Tseng, H. and Tsai, J. (2005) Brain Abscess: Clinical Experience and Analysis of Prognostic Factors. Surgical Neurology, 63, 442-449. https://doi.org/10.1016/j.surneu.2004.08.093
[70]
Evans, T.J., Jawad, S., Kalyal, N., Nadarajah, A., Amarouche, M., Stapleton, S., et al. (2022) Retrospective Review of the Epidemiology, Microbiology, Management and Outcomes of Intra-Cranial Abscesses at a Neurosurgical Tertiary Referral Centre, 2018-2020. Annals of Clinical Microbiology and Antimicrobials, 21, Article No. 58. https://doi.org/10.1186/s12941-022-00550-2
[71]
Al Masalma, M., Lonjon, M., Richet, H., Dufour, H., Roche, P.H., Drancourt, M., et al. (2011) Metagenomic Analysis of Brain Abscesses Identifies Specific Bacterial Associations. Clinical Infectious Diseases, 54, 202-210. https://doi.org/10.1093/cid/cir797
[72]
Kommedal, ?., Wilhelmsen, M.T., Skrede, S., Meisal, R., Jakovljev, A., Gaustad, P., et al. (2014) Massive Parallel Sequencing Provides New Perspectives on Bacterial Brain Abscesses. Journal of Clinical Microbiology, 52, 1990-1997. https://doi.org/10.1128/jcm.00346-14
[73]
Stebner, A., Ensser, A., Gei?d?rfer, W., Bozhkov, Y. and Lang, R. (2021) Molecular Diagnosis of Polymicrobial Brain Abscesses with 16S-rDNA-Based Next-Generation Sequencing. Clinical Microbiology and Infection, 27, 76-82. https://doi.org/10.1016/j.cmi.2020.03.028
[74]
John, D.V., Aryalakshmi, B., Deora, H., Purushottam, M., Raju, R., Mahadevan, A., et al. (2022) Identification of Microbial Agents in Culture-Negative Brain Abscess Samples by 16S/18S rRNA Gene PCR and Sequencing. Tropical Biomedicine, 39, 489-498. https://doi.org/10.47665/tb.39.4.002
[75]
Son, H., Moon, J., Ha, E.J., Kim, N., Kim, E., Lee, H.S., et al. (2023) Identification of Bacterial Pathogens in Brain Abscesses by Metagenomic Approach Using Nanopore 16S Amplicon Sequencing. Diagnostic Microbiology and Infectious Disease, 107, Article ID: 116041. https://doi.org/10.1016/j.diagmicrobio.2023.116041
[76]
Banerjee, A.D., Pandey, P., Devi, B.I., Sampath, S. and Chandramouli, B.A. (2009) Pediatric Supratentorial Subdural Empyemas: A Retrospective Analysis of 65 Cases. Pediatric Neurosurgery, 45, 11-18. https://doi.org/10.1159/000202619
[77]
Lannon, M., Trivedi, A., Martyniuk, A., Farrokhyar, F. and Sharma, S. (2022) Surgical Aspiration versus Excision for Intraparenchymal Abscess: A Systematic Review and Meta-Analysis. British Journal of Neurosurgery, 36, 743-749. https://doi.org/10.1080/02688697.2022.2118231
[78]
Wolff, R.F., Moons, K.G.M., Riley, R.D., Whiting, P.F., Westwood, M., Collins, G.S., et al. (2019) PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170, 51-58. https://doi.org/10.7326/m18-1376