Explainable Deep Learning Model for Predicting Serious Adverse Events in Hospitalized Geriatric Patients Within 72 Hours
DOI: https://doi.org/10.2147/cia.s460562
IF: 3.829
2024-06-13
Clinical Interventions in Aging
Abstract:Ting-Yu Hsu, 1 Chi-Yung Cheng, 1, 2, &ast I-Min Chiu, 1, 2 Chun-Hung Richard Lin, 2 Fu-Jen Cheng, 1 Hsiu-Yung Pan, 1 Yu-Jih Su, 3 Chao-Jui Li 1, &ast 1 Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung, Taiwan; 2 Department of Computer Science and Engineering, National Sun Yat-Sen University, Kaohsiung, Taiwan; 3 Department of Internal Medicine, Division of Rheumatology, Allergy and Immunology, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan &astThese authors contributed equally to this work Correspondence: Chi-Yung Cheng; Chao-Jui Li, Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, 123 Ta-Pei Road, Niao-Sung, Kaohsiung, 833, Taiwan, Tel +886-7-7317123 ext. 8415, Email ; Background: The global aging population presents a significant challenge, with older adults experiencing declining physical and cognitive abilities and increased vulnerability to chronic diseases and adverse health outcomes. This study aims to develop an interpretable deep learning (DL) model to predict adverse events in geriatric patients within 72 hours of hospitalization. Methods: The study used retrospective data (2017– 2020) from a major medical center in Taiwan. It included non-trauma geriatric patients who visited the emergency department and were admitted to the general ward. Data preprocessing involved collecting prognostic factors like vital signs, lab results, medical history, and clinical management. A deep feedforward neural network was developed, and performance was evaluated using accuracy, sensitivity, specificity, positive predictive value (PPV), and area under the receiver operating characteristic curve (AUC). Model interpretation utilized the Shapley Additive Explanation (SHAP) technique. Results: The analysis included 127,268 patients, with 2.6% experiencing imminent intensive care unit transfer, respiratory failure, or death during hospitalization. The DL model achieved AUCs of 0.86 and 0.84 in the validation and test sets, respectively, outperforming the Sequential Organ Failure Assessment (SOFA) score. Sensitivity and specificity values ranged from 0.79 to 0.81. The SHAP technique provided insights into feature importance and interactions. Conclusion: The developed DL model demonstrated high accuracy in predicting serious adverse events in geriatric patients within 72 hours of hospitalization. It outperformed the SOFA score and provided valuable insights into the model's decision-making process. Keywords: explainable machine learning, deep learning algorithm, adverse events, mortality Graphical The aging of the population presents a significant global challenge recognized by many countries. According to the United Nations, the proportion of people aged 65 and older is projected to increase from 9% in 2021 to 16% by 2050. This demographic shift will mark the first time in history that the number of older adults exceeds that of children under the age of 5. 1 As individuals age, their physical and cognitive abilities decline, rendering them more susceptible to chronic diseases and adverse health outcomes. Chronic diseases are particularly prevalent in older adults, leading to a gradual decline in physical function, quality of life, and an increased risk of complications and mortality. 2 Managing chronic conditions necessitates ongoing medical care and support, resulting in substantial care burdens and expenses. For example, in the United States, Medicare spending on individuals aged 65 and older reached $702 billion in 2019, constituting 21% of total national health expenditures. 3 The Charlson Comorbidity Index (CCI), Acute Physiology and Chronic Health Evaluation (APACHE) II, and Sequential Organ Failure Assessment (SOFA) score are commonly used to predict mortality risk in hospitalized patients. CCI is a widely used comorbidity index that assigns weights to medical conditions based on their association with mortality, while APACHE II evaluates patients' acute and chronic health status using physiological variables and comorbidities. 4,5 SOFA score assesses the extent of organ dysfunction in critically ill patients. 6,7 However, none of these scores are specifically designed for older adults and do not account for the unique physiological changes and comorbidities associated with aging. Although these scores have been shown to be reliable predictors of mortality risk in various patient populations, they do not consider age-related physiological changes, which may affect the accuracy of -Abstract Truncated-
geriatrics & gerontology,gerontology