Abstract:Importance: Current methods for identifying hospitalized patients at increased risk of delirium require nurse-administered questionnaires with moderate accuracy.Objective: To develop and validate a machine learning model that predicts incident delirium risk based on electronic health data available on admission.Design, Setting, and Participants: Retrospective cohort study evaluating 5 machine learning algorithms to predict delirium using 796 clinical variables identified by an expert panel as relevant to delirium prediction and consistently available in electronic health records within 24 hours of admission. The training set comprised 14 227 adult patients with non-intensive care unit hospital stays and no delirium on admission who were discharged between January 1, 2016, and August 31, 2017, from UCSF Health, a large academic health institution. The test set comprised 3996 patients with hospital stays who were discharged between August 1, 2017, and November 30, 2017.Exposures: Patient demographic characteristics, diagnoses, nursing records, laboratory results, and medications available in electronic health records during hospitalization.Main Outcomes and Measures: Delirium was defined as a positive Nursing Delirium Screening Scale or Confusion Assessment Method for the Intensive Care Unit score. Models were assessed using the area under the receiver operating characteristic curve (AUC) and compared against the 4-point scoring system AWOL (age >79 years, failure to spell world backward, disorientation to place, and higher nurse-rated illness severity), a validated delirium risk-assessment tool routinely administered in this cohort.Results: The training set included 14 227 patients (5113 [35.9%] aged >64 years; 7335 [51.6%] female; 687 [4.8%] with delirium), and the test set included 3996 patients (1491 [37.3%] aged >64 years; 1966 [49.2%] female; 191 [4.8%] with delirium). In total, the analysis included 18 223 hospital admissions (6604 [36.2%] aged >64 years; 9301 [51.0%] female; 878 [4.8%] with delirium). The AWOL system achieved a baseline AUC of 0.678. The gradient boosting machine model performed best, with an AUC of 0.855. Setting specificity at 90%, the model had a 59.7% (95% CI, 52.4%-66.7%) sensitivity, 23.1% (95% CI, 20.5%-25.9%) positive predictive value, 97.8% (95% CI, 97.4%-98.1%) negative predictive value, and a number needed to screen of 4.8. Penalized logistic regression and random forest models also performed well, with AUCs of 0.854 and 0.848, respectively.Conclusions and Relevance: Machine learning can be used to estimate hospital-acquired delirium risk using electronic health record data available within 24 hours of hospital admission. Such a model may allow more precise targeting of delirium prevention resources without increasing the burden on health care professionals.

Development and validation of a machine learning model to predict postoperative delirium using a nationwide database: A retrospective, observational study

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Development of postoperative delirium prediction models in patients undergoing cardiovascular surgery using machine learning algorithms

Development and Validation of Machine Learning Models to Predict Postoperative Delirium Using Clinical Features and Polysomnography Variables

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Machine learning-based delirium prediction in surgical in-patients: a prospective validation study

Development and validation of delirium prediction models for noncardiac surgery patients

Development and Validation of an Electronic Health Record–Based Machine Learning Model to Estimate Delirium Risk in Newly Hospitalized Patients Without Known Cognitive Impairment

Development and Validation of a Post-Operative Delirium Prediction Model for Patients Undergoing Abdominal Surgery: A Retrospective, Observational, Single-Center Study

Machine Learning Algorithm Using Electronic Chart-Derived Data to Predict Delirium After Elderly Hip Fracture Surgeries: A Retrospective Case-Control Study

Predicting delirium and the effects of medications in hospitalized COVID-19 patients using machine learning: A retrospective study within the Korean Multidisciplinary Cohort for Delirium Prevention (KoMCoDe)

Prediction of Postoperative Delirium in Geriatric Hip Fracture Patients: A Clinical Prediction Model Using Machine Learning Algorithms

Postoperative delirium prediction using machine learning models and preoperative electronic health record data

Machine learning with clinical and intraoperative biosignal data for predicting postoperative delirium after cardiac surgery

Predicting postoperative delirium assessed by the Nursing Screening Delirium Scale in the recovery room for non-cardiac surgeries without craniotomy: A retrospective study using a machine learning approach

Application of machine learning for delirium prediction and analysis of associated factors in hospitalized COVID-19 patients: A comparative study using the Korean Multidisciplinary cohort for delirium prevention (KoMCoDe)

Automated machine learning‐based model predicts postoperative delirium using readily extractable perioperative collected electronic data

Predicting postoperative delirium after cardiovascular surgeries from preoperative portable electroencephalography oscillations

Machine Learning for Prediction of Postoperative Delirium in Adult Patients: A Systematic Review and Meta-analysis

Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Nomogram for Prediction of Postoperative Delirium after Deep Brain Stimulation of Subthalamic Nucleus in Parkinson's Disease under General Anesthesia