Abstract:Abstract Introduction Delirium occurrence is common and preventive strategies are resource intensive. Screening tools can prioritize patients at risk. Using machine learning, we can capture time and treatment effects that pose a challenge to delirium prediction. We aim to develop a delirium prediction model that can be used as a screening tool. Methods From the eICU Collaborative Research Database (eICU-CRD) and the Medical Information Mart for Intensive Care version III (MIMIC-III) database, patients with one or more Confusion Assessment Method-Intensive Care Unit (CAM-ICU) values and intensive care unit (ICU) length of stay greater than 24 h were included in our study. We validated our model using 21 quantitative clinical parameters and assessed performance across a range of observation and prediction windows, using different thresholds and applied interpretation techniques. We evaluate our models based on stratified repeated cross-validation using 3 algorithms, namely Logistic Regression, Random Forest, and Bidirectional Long Short-Term Memory (BiLSTM). BiLSTM represents an evolution from recurrent neural network-based Long Short-Term Memory, and with a backward input, preserves information from both past and future. Model performance is measured using Area Under Receiver Operating Characteristic, Area Under Precision Recall Curve, Recall, Precision (Positive Predictive Value), and Negative Predictive Value metrics. Results We evaluated our results on 16 546 patients (47% female) and 6294 patients (44% female) from eICU-CRD and MIMIC-III databases, respectively. Performance was best in BiLSTM models where, precision and recall changed from 37.52% (95% confidence interval [CI], 36.00%–39.05%) to 17.45 (95% CI, 15.83%–19.08%) and 86.1% (95% CI, 82.49%–89.71%) to 75.58% (95% CI, 68.33%–82.83%), respectively as prediction window increased from 12 to 96 h. After optimizing for higher recall, precision and recall changed from 26.96% (95% CI, 24.99%–28.94%) to 11.34% (95% CI, 10.71%–11.98%) and 93.73% (95% CI, 93.1%–94.37%) to 92.57% (95% CI, 88.19%–96.95%), respectively. Comparable results were obtained in the MIMIC-III cohort. Conclusions Our model performed comparably to contemporary models using fewer variables. Using techniques like sliding windows, modification of threshold to augment recall and feature ranking for interpretability, we addressed shortcomings of current models.

A novel semiautomatic Chinese keywords instrument screening delirium based on electronic medical records

Design and Clinical Application of an Information Module for Delirium Assessment in ICU

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Clinical utility and validation of two instruments (the Confusion Assessment Method Algorithm and the Chinese version of Nursing Delirium Screening Scale) to detect delirium in geriatric inpatients

Delirium screening tools: A protocol for a systematic review and meta-analysis.

Shanghai Cognitive Screening: A Mobile Cognitive Assessment Tool Using Voice Recognition to Detect Mild Cognitive Impairment and Dementia in the Community.

Detecting delirium: a systematic review of ultrabrief identification instruments for hospital patients

An online delirium detection tool: Cross-cultural adaptation of a Chinese version of the Family Confusion Assessment Method

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Delirium Assessment Tools Among Hospitalized Older Adults: A Systematic Review and Metaanalysis of Diagnostic Accuracy

Cross-cultural Adaptation and Validation of the 3D-CAM Chinese Version in Surgical ICU Patients.

Electroencephalography as a tool for assessing delirium in hospitalized patients: A single-center tertiary hospital experience

Using Machine Learning and Electronic Health Records to Identify Neuropsychiatric Risk Scores for Delirium in ICU and General Hospital Settings

Identifying Symptoms of Delirium from Clinical Narratives Using Natural Language Processing

Delirium prediction in the ICU: designing a screening tool for preventive interventions

A Fully Automated Mini-Mental State Examination Assessment Model Using Computer Algorithms for Cognitive Screening

A Pilot Study of the Fluctuating Mental Status Evaluation: A Novel Delirium Screening Tool for Neurocritical Care Patients

Research Progress on ICU Delirium Assessment Instrument at Home and Abroad

Leveraging the Electronic Health Record to Implement Emergency Department Delirium Screening

Delirium detection tools show varying completion rates and positive score rates when used at scale in routine practice in general hospital settings: A systematic review

Prevalence, Risk Factors, and Complaints Screening Tool Exploration of Subjective Cognitive Decline in a Large Cohort of the Chinese Population