Abstract:Background and objective: Delirium is the most common neuropsychological complication among older adults admitted to the intensive care unit (ICU) and is often associated with a poor prognosis. This study aimed to construct and validate an interpretable machine learning (ML) for early delirium prediction in older ICU patients. Methods: This was a retrospective observational cohort study and patient data were extracted from the Medical Information Mart for Intensive Care-IV database. Feature variables associated with delirium, including predisposing factors, disease-related factors, and iatrogenic and environmental factors, were selected using least absolute shrinkage and selection operator regression, and prediction models were built using logistic regression, decision trees, support vector machines, extreme gradient boosting (XGBoost), k-nearest neighbors and naive Bayes methods. Multiple metrics were used for evaluation of performance of the models, including the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, recall, F1 score, calibration plot, and decision curve analysis. SHapley Additive exPlanations (SHAP) were used to improve the interpretability of the final model. Results: Nine thousand seven hundred forty-eight adults aged 65 years or older were included for analysis. Twenty-six features were selected to construct ML prediction models. Among the models compared, the XGBoost model demonstrated the best performance including the highest AUC (0.836), accuracy (0.765), sensitivity (0.713), recall (0.713), and F1 score (0.725) in the training set. It also exhibited excellent discrimination with AUC of 0.810, good calibration, and had the highest net benefit in the validation cohort. The SHAP summary analysis showed that Glasgow Coma Scale, mechanical ventilation, and sedation were the top three risk features for outcome prediction. The SHAP dependency plot and SHAP force analysis interpreted the model at both the factor level and individual level, respectively. Conclusion: ML is a reliable tool for predicting the risk of critical delirium in elderly patients. By combining XGBoost and SHAP, it can provide clear explanations for personalized risk prediction and more intuitive understanding of the effect of key features in the model. The establishment of such a model would facilitate the early risk assessment and prompt intervention for delirium.

ICU Delirium Prediction Models: A Systematic Review

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Research progress in the Delirium Risk Prediction Models of post-operative patients in ICU

Delirium risk prediction models for intensive care unit patients: A systematic review

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Prediction models for postoperative delirium after cardiac surgery: Systematic review and critical appraisal

Delirium prediction in the ICU: designing a screening tool for preventive interventions

Development and Validation of Simplified Delirium Prediction Model in Intensive Care Unit

Development and validation of delirium prediction model for critically ill adults parameterized to ICU admission acuity

Head-to-head comparison of 14 prediction models for postoperative delirium in elderly non-ICU patients: an external validation study

Development and validation of delirium prediction models for noncardiac surgery patients

Nomogram Models for Predicting Delirium of Patients in Emergency Intensive Care Unit: A Retrospective Cohort Study

Early prediction of delirium upon intensive care unit admission: Model development, validation, and deployment

Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Machine Learning–Based Prediction Models for Delirium: A Systematic Review and Meta-Analysis

Calibration of the PREdiction of DELIRium in ICu Patients (PRE-DELIRIC) Score in a Cohort of Critically Ill Patients: A Retrospective Cohort Study

Comparison of the effectiveness of delirium evaluation tools in intensive care patients: pre-deliric versions 1 and 2, E-pre-deliric and ICDSC

Prognostic Accuracy of Delirium Prediction Models.

Development and External Validation of a Delirium Prediction Model for Hospitalized Patients With Coronavirus Disease 2019

Interpretable machine learning model for early prediction of delirium in elderly patients following intensive care unit admission: a derivation and validation study

Comparison of Prognostic Accuracy of 3 Delirium Prediction Models