Prognostic Accuracy of Delirium Prediction Models.

K. Rosenberg

DOI: https://doi.org/10.1097/01.NAJ.0000925520.21363.23

2023-04-01

The American Journal of Nursing

Abstract:According to this study: The prognostic accuracy of models used to predict delirium in patients admitted to the ICU varies.The PRE-DELIRIC model performs best and can be used in both patients receiving and not receiving mechanical ventilation.

Medicine

What problem does this paper attempt to address?

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Xiangping Chen,Yuewen Lao,Yi Zhang,Lijie Qiao,Yiyu Zhuang

DOI: https://doi.org/10.21037/apm-20-1183

2020-01-01

Annals of Palliative Medicine

Abstract:BACKGROUND:An emerging approach to prevent delirium in an intensive care unit is the use of risk prediction models. At present, there is no scientific comparison of the predictive effect of the prediction model. This systematic review and meta-analysis aimed to compare the performance of available delirium risk prediction models for intensive care units.METHODS:As of June 1st, 2019, articles on delirium prediction models of the intensive care patients were searched in the Cochrane Library, PubMed, Embase, Web of Science, CINAHL, ProQuest, and four Chinese databases. Studies describing the development or validation of risk prediction models for predicting delirium in ICU patients were included. The Prediction model Risk of Bias Assessment Tool (PROBAST) was used to assess the quality of included studies. A meta-analysis of the predictive performance was performed using the forest plot package in R3.6.1.RESULTS:A total of 21 studies with 14 models were included in this article. PRE-DELIRIC, E-PREDELIRIC, and recalibrated PRE-DELIRIC model were the most popular models, which had been externally validated in at least two studies. The pooled area under the receiver operator characteristic curve (AUC) were 0.844 (95% CI: 0.793-0.896), 0.763 (95% CI: 0.680-0.846) and 0.776 (95% CI: 0.738-0.813) respectively. Most of the other models were with C-statistics above 0.7.CONCLUSIONS:The E-PRE-DELIRIC model, PRE-DELIRIC model, or both are recommended to predict ICU delirium risk. However, the recommendation should be considered with caution because of substantial heterogeneity. The protocol was registered with PROSPERO (CRD42019130802).
Research progress in the Delirium Risk Prediction Models of post-operative patients in ICU

陈香萍,庄一渝,乔丽杰,劳月文,张奕,吴菲霞

DOI: https://doi.org/10.3760/cma.j.cn211501-20191227-03846

2020-01-01

Abstract:Regular assessment is a key to early detect and treat delirium. However, studies showed poor compliance and accuracy of delirium assessment by nurses. Moreover, delirium was characterized by acute onset and fluctuation of cognition. Therefore, delirium was frequently unrecognized. Postoperative delirium incidence in the intensive care unit was high and associated with poor outcome. Studies demonstrate delirium was preventable. Delirium prediction models were warranted to identify high-risk critically ill patients in order to apply preventive strategies. This article was to provide an overview of postoperative delirium and review postoperative delirium prediction models for surgical patients in the intensive care unit, thereby providing reference for development, validation as well as application of models in China.
Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Wen Gao,Yuping Zhang,Jingfen Jin

DOI: https://doi.org/10.1111/nicc.12674

2022-01-01

Nursing in Critical Care

Abstract:Background The early prediction model for delirium in intensive care units (ICUs)-E-PRE-DELIRIC-has been created to predict delirium development during the length of stay in ICUs. However, there have been few early predictive models for delirium in the cardiac surgical ICU (CSICU), and the predictive ability of the E-PRE-DELIRIC among patients following cardiac surgeries is still unknown. Aims and objectives To validate the performance of E-PRE-DELIRIC in CSICU. Design A retrospective cohort study. Methods Data were retrospectively extracted from the electronic records for patients admitted in CSICU from January 2018 to December 2018 in a tertiary teaching hospital in China. Adult patients were included following the criteria of the E-PRE-DELIRIC model. Predictors, including age, history of cognitive impairment, history of alcohol abuse, urgent admission, use of corticosteroids, respiratory failure, blood urea nitrogen, and mean arterial pressure, at the time of ICU admission were retrieved, and delirium was assessed twice a day using the Confusion Assessment Method for the ICU. The performance of the E-PRE-DELIRIC model was evaluated by area under receiver operator characteristic curve, precision-recall curve (AUPRC), Hosmer-Lemeshow (HL) test, and calibration belt. Results Of the 725 patients included, 120 (16.6%) developed delirium. The AUROC was 0.54 (95% confidence interval [CI], 0.48-0.59), and the AUPRC was 0.18 (95% CI, 0.12-0.20). The HL test showed a significant difference between predicted probability and delirium occurrence (chi(2) = 17.326, P = .027), and the overestimation chance of the E-PRE-DELIRIC score was 0.24 to 0.43. Conclusion The E-PRE-DELIRIC model has poor-to-fair predictive value in this study; thus, its application among the CSICU patients is limited. Development of reliable and validated tools for early prediction of delirium in CSICU is required. Relevance to clinical practice Early prediction of delirium risk at CSICU admission is of vital importance and could provide timely information to caregivers. However, the E-PRE-DELIRIC model should be applied cautiously in the CSICU because of the significant probability of over-estimating the risk of developing delirium.
ICU Delirium Prediction Models: A Systematic Review

Matthew M Ruppert,Jessica Lipori,Sandip Patel,Elizabeth Ingersent,Tezcan Ozrazgat-Baslanti,Tyler Loftus,Parisa Rashidi,Azra Bihorac

DOI: https://doi.org/10.48550/arXiv.1911.02548

2019-10-21

Abstract:Purpose: Summarize ICU delirium prediction models published within the past five years. Methods: Electronic searches were conducted in April 2019 using PubMed, Embase, Cochrane Central, Web of Science, and CINAHL to identify peer reviewed studies published in English during the past five years that specifically addressed the development, validation, or recalibration of delirium prediction models in adult ICU populations. Data were extracted using CHARMS checklist elements for systematic reviews of prediction studies, including the following characteristics: study design, participant descriptions and recruitment methods, predicted outcomes, a priori candidate predictors, sample size, model development, model performance, study results, interpretation of those results, and whether the study included missing data. Results: Twenty studies featuring 26 distinct prediction models were included. Model performance varied greatly, as assessed by AUROC (0.68-0.94), specificity (56.5%-92.5%), and sensitivity (59%-90.9%). Most models used data collected from a single time point or window to predict the occurrence of delirium at any point during hospital or ICU admission, and lacked mechanisms for providing pragmatic, actionable predictions to clinicians. Conclusions: Although most ICU delirium prediction models have relatively good performance, they have limited applicability to clinical practice. Most models were static, making predictions based on data collected at a single time-point, failing to account for fluctuating conditions during ICU admission. Further research is needed to create clinically relevant dynamic delirium prediction models that can adapt to changes in individual patient physiology over time and deliver actionable predictions to clinicians.

Applications
Delirium risk prediction models for intensive care unit patients: A systematic review

Junshan Chen,Jintian Yu,Aiqin Zhang

DOI: https://doi.org/10.1016/j.iccn.2020.102880

Abstract:Objective: To systematically review the delirium risk prediction models for intensive care unit (ICU) patients. Methods: A systematic review was conducted. The Cochrane Library, PubMed, Ovid and Web of Science were searched to collect studies on delirium risk prediction models for ICU patients from database establishment to 31 March 2019. Two reviewers independently screened the literature according to the pre-determined inclusion and exclusion criteria, extracted the data and evaluated the risk of bias of the included studies using the CHARMS (CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies) checklist. A descriptive analysis was used to describe and summarise the data. Results: A total of six models were included. All studies reported the area under the receiver operating characteristic curve (AUROC) of the prediction models in the derivation and (or) validation datasets as over 0.7 (from 0.75 to 0.9). Five models reported calibration metrics. Decreased cognitive reserve and the Acute Physiology and Chronic Health Evaluation II (APACHE-II) score were the most commonly reported predisposing and precipitating factors, respectively, of ICU delirium among all models. The small sample size, lack of external validation and the absence of or unreported blinding method increased the risk of bias. Conclusion: According to the discrimination and calibration statistics reported in the original studies, six prediction models may have moderate power in predicting ICU delirium. However, this finding should be interpreted with caution due to the risk of bias in the included studies. More clinical studies should be carried out to validate whether these tools have satisfactory predictive performance in delirium risk prediction for ICU patients.
Prediction models for postoperative delirium after cardiac surgery: Systematic review and critical appraisal

Shining Cai,Jingjing Li,Jian Gao,Wenyan Pan,Yuxia Zhang

DOI: https://doi.org/10.1016/j.ijnurstu.2022.104340

IF: 8.1

2022-01-01

International Journal of Nursing Studies

Abstract:Background: Many studies have developed or validated prediction models to estimate the risk of delirium after cardiac surgery, but the quality of the model development and model applicability remain unknown.Objectives: To systematically review and critically evaluate currently available prediction models for delirium after cardiac surgery.Data sources: PubMed, EMBASE, and MEDLINE were systematically searched. This systematic review was regis-tered in PROSPERO (Registration ID: CRD42021251226).Study selection: Prospective or retrospective cohort studies were considered eligible if they developed or vali-dated prediction models or scoring systems for delirium in the ICU. We included studies involving adults (age >= 18 years) undergoing cardiac surgery and excluded studies that did not validate a prediction model.Data extraction: Data extraction was independently performed by two authors using a standardized data extrac-tion form based on the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Stud-ies checklist. Quality of the models was assessed with the Prediction Model Risk of Bias Assessment Tool (PROBAST).Data synthesis: Of 5469 screened studies, 13 studies described 10 prediction models. The postoperative delirium incidence varied from 11.3 % to 51.6 %. The most frequently used predictors were age and cognitive impairment. The reported areas under the curve or C-statistics were between of 0.74 and 0.91 in the derivation set. The re-ported AUCs in the external validation set were between 0.54 and 0.90. All the studies had a high risk of bias, mainly owing to poor reporting of the outcome domain and analysis domain; 10 studies were of high concern regarding applicability.Conclusions: The current models for predicting postoperative delirium in the ICU after cardiac surgery had a high risk of bias according to the PROBAST. Future studies should focus on improving current prediction models or de-veloping new models with rigorous methodology.(c) 2022 Published by Elsevier Ltd.
Evaluation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for the patients in the intensive care unit

Gabrielė Linkaitė,Mantas Riauka,Ignė Bunevičiūtė,Saulius Vosylius

DOI: https://doi.org/10.6001/actamedica.v25i1.3699

2018-05-14

Acta medica Lituanica

Abstract:Introduction. Delirium not only compromises patient care, but is also associated with poorer outcomes: increased duration of mechanical ventilation, higher mortality, and greater long-term cognitive dysfunction. The PRE-DELIRIC model is a tool used to calculate the risk of the development of delirium. The classification of the patients into groups by risk allows efficient initiation of preventive measures. The goal of this study was to validate the PRE-DELIRIC model using the CAM-ICU (The Confusion Assessment Method for the Intensive Care Unit) method for the diagnosis of delirium. Materials and methods. Patients admitted to the University Hospital of Vilnius during February 2015 were enrolled. Every day, data were collected for APACHE-II and PRE-DELIRIC scores. Out of 167 patients, 38 (23%) were included and screened using the CAM-ICU method within 24 hours of admission to the ICU. We defined patients as having delirium when they had at least one positive CAM-ICU screening or haloperidol administration due to sedation. To validate the PRE-DELIRIC model, we calculated the area under receiver operating characteristic curve. Results. The mean age of the patients was 69.2 ± 17.2 years, 19 (50%) were male, APACHE-II mean score 18.0 ± 7.4 points. Delirium was diagnosed in 22 (58%) of 38 patients. Data used for validation of the PRE-DELIRIC model resulted in an area under the curve of 0.713 (p < 0.05, 95% CI 0.539–0.887); sensitivity and specificity for the patients with 20% risk were, accordingly, 77.3% and 50%; 40% risk – 45.5% and 81.3%, 60% – 36.4%, and 87.5%. Conclusions. The PRE-DELIRIC model predicted delirium in the patients within 24 hours of admission to the ICU. Preventive therapy could be efficiently targeted at high-risk patients if both of the methods are to be implemented.
Development and validation of delirium prediction models for noncardiac surgery patients

Julian Rössler,Karan Shah,Sara Medellin,Alparslan Turan,Kurt Ruetzler,Mriganka Singh,Daniel I Sessler,Kamal Maheshwari,Daniel I. Sessler

DOI: https://doi.org/10.1016/j.jclinane.2023.111319

IF: 9.375

2024-05-01

Journal of Clinical Anesthesia

Abstract:STUDY OBJECTIVE: Postoperative delirium is associated with morbidity and mortality, and its incidence varies widely. Using known predisposing and precipitating factors, we sought to develop postoperative delirium prediction models for noncardiac surgical patients.DESIGN: Retrospective prediction model study.SETTING: Major quaternary medical center.PATIENTS: Our January 2016 to June 2020 training dataset included 51,677 patients of whom 2795 patients had delirium. Our July 2020 to January 2022 validation dataset included 14,438 patients of whom 912 patients had delirium.INTERVENTIONS: None.MEASUREMENTS: We trained and validated two static prediction models and one dynamic delirium prediction model. For the static models, we used random survival forests and traditional Cox proportional hazard models to predict postoperative delirium from preoperative variables, or from a combination of preoperative and intraoperative variables. We also used landmark modeling to dynamically predict postoperative delirium using preoperative, intraoperative, and postoperative variables before onset of delirium.MAIN RESULTS: In the validation analyses, the static random forest model had a c-statistic of 0.81 (95% CI: 0.79, 0.82) and a Brier score of 0.04 with preoperative variables only, and a c-statistic of 0.86 (95% CI: 0.84, 0.87) and a Brier score of 0.04 when preoperative and intraoperative variables were combined. The corresponding Cox models had similar discrimination metrics with slightly better calibration. The dynamic model - using all available data, i.e., preoperative, intraoperative and postoperative data - had an overall c-index of 0.84 (95% CI: 0.83, 0.85).CONCLUSIONS: Using preoperative and intraoperative variables, simple static models performed as well as a dynamic delirium prediction model that also included postoperative variables. Baseline predisposing factors thus appear to contribute far more to delirium after noncardiac surgery than intraoperative or postoperative variables. Improved postoperative data capture may help improve delirium prediction and should be evaluated in future studies.

anesthesiology
Delirium prediction in the ICU: designing a screening tool for preventive interventions

Anirban Bhattacharyya,Seyedmostafa Sheikhalishahi,Heather Torbic,Wesley Yeung,Tiffany Wang,Jennifer Birst,Abhijit Duggal,Leo Anthony Celi,Venet Osmani

DOI: https://doi.org/10.1093/jamiaopen/ooac048

2022-04-06

JAMIA Open

Abstract:Abstract Introduction Delirium occurrence is common and preventive strategies are resource intensive. Screening tools can prioritize patients at risk. Using machine learning, we can capture time and treatment effects that pose a challenge to delirium prediction. We aim to develop a delirium prediction model that can be used as a screening tool. Methods From the eICU Collaborative Research Database (eICU-CRD) and the Medical Information Mart for Intensive Care version III (MIMIC-III) database, patients with one or more Confusion Assessment Method-Intensive Care Unit (CAM-ICU) values and intensive care unit (ICU) length of stay greater than 24 h were included in our study. We validated our model using 21 quantitative clinical parameters and assessed performance across a range of observation and prediction windows, using different thresholds and applied interpretation techniques. We evaluate our models based on stratified repeated cross-validation using 3 algorithms, namely Logistic Regression, Random Forest, and Bidirectional Long Short-Term Memory (BiLSTM). BiLSTM represents an evolution from recurrent neural network-based Long Short-Term Memory, and with a backward input, preserves information from both past and future. Model performance is measured using Area Under Receiver Operating Characteristic, Area Under Precision Recall Curve, Recall, Precision (Positive Predictive Value), and Negative Predictive Value metrics. Results We evaluated our results on 16 546 patients (47% female) and 6294 patients (44% female) from eICU-CRD and MIMIC-III databases, respectively. Performance was best in BiLSTM models where, precision and recall changed from 37.52% (95% confidence interval [CI], 36.00%–39.05%) to 17.45 (95% CI, 15.83%–19.08%) and 86.1% (95% CI, 82.49%–89.71%) to 75.58% (95% CI, 68.33%–82.83%), respectively as prediction window increased from 12 to 96 h. After optimizing for higher recall, precision and recall changed from 26.96% (95% CI, 24.99%–28.94%) to 11.34% (95% CI, 10.71%–11.98%) and 93.73% (95% CI, 93.1%–94.37%) to 92.57% (95% CI, 88.19%–96.95%), respectively. Comparable results were obtained in the MIMIC-III cohort. Conclusions Our model performed comparably to contemporary models using fewer variables. Using techniques like sliding windows, modification of threshold to augment recall and feature ranking for interpretability, we addressed shortcomings of current models.
Utility of a prediction model for delirium in intensive care unit patients (PRE-DELIRIC) in mechanically ventilated patients with sepsis

Kyohei Miyamoto,Tsuyoshi Nakashima,Nozomu Shima,Seiya Kato,Yu Kawazoe,Takeshi Morimoto,Yoshinori Ohta,Hitoshi Yamamura,DESIRE Trial Investigators,Masaou Tanaka,Tomonori Yamamoto,Akihiro Fuke,Atsunori Hashimoto,Hiroyuki Koami,Satoru Beppu,Yoichi Katayama,Makoto Itoh

DOI: https://doi.org/10.1002/ams2.589

2020-11-04

Abstract:Aim: Delirium frequently develops in patients with sepsis during their intensive care unit (ICU) stay, which is associated with increased morbidity and mortality. A prediction model for delirium in patients in ICU, PRE-DELIRIC, has been utilized in overall ICU patients, but its utility is uncertain among patients with sepsis. This study aims to examine the utility of PRE-DELIRIC to predict delirium in mechanically ventilated patients with sepsis. Methods: This is a post hoc analysis of a randomized clinical trial in eight Japanese ICUs, which aimed to evaluate the sedative strategy with/without dexmedetomidine in adult mechanically ventilated patients with sepsis. The Confusion Assessment Method for the ICU was used every day to assess for delirium throughout their ICU stay. We excluded patients who were delirious on the first day of ICU, those who were under sustained coma throughout their ICU stay, and those who stayed in the ICU less than 24 h. The discriminative ability of PRE-DELIRIC was evaluated by measuring the area under the receiver operating characteristic curve (AUROC). Results: Of the 201 patients enrolled in the trial, we analyzed 158 patients. The mean age was 69.4 ± 14.0 years, and 99 patients (63%) were men. Delirium occurred at least once during the ICU stay of 63 patients (40%). The AUROC of PRE-DELIRIC was 0.60 (95% confidence interval, 0.50-0.69). Subgroup analyses indicated that PRE-DELIRIC was useful in those with Sequential Organ Failure Assessment score >8 with AUROC of 0.65 (95% confidence interval, 0.51-0.77). Conclusions: The PRE-DELIRIC model could not predict delirium in mechanically ventilated patients with sepsis.
Early prediction of delirium upon intensive care unit admission: Model development, validation, and deployment

Man-Ling Wang,Yu-Ting Kuo,Lu-Cheng Kuo,Hsin-Ping Liang,Yi-Wei Cheng,Yu-Chen Yeh,Ming-Tao Tsai,Wing-Sum Chan,Ching-Tang Chiu,Anne Chao,Nai-Kuan Chou,Yu-Chang Yeh,Shih-Chi Ku

DOI: https://doi.org/10.1016/j.jclinane.2023.111121

IF: 9.375

2023-09-01

Journal of Clinical Anesthesia

Abstract:STUDY OBJECTIVE: To develop, validate, and deploy models for predicting delirium in critically ill adult patients as early as upon intensive care unit (ICU) admission.DESIGN: Retrospective cohort study.SETTING: Single university teaching hospital in Taipei, Taiwan.PATIENTS: 6238 critically ill patients from August 2020 to August 2021.MEASUREMENTS: Data were extracted, pre-processed, and split into training and testing datasets based on the time period. Eligible variables included demographic characteristics, Glasgow Coma Scale, vital signs parameters, treatments, and laboratory data. The predicted outcome was delirium, defined as any positive result (a score ≥ 4) of the Intensive Care Delirium Screening Checklist that was assessed by primary care nurses in each 8-h shift within 48 h after ICU admission. We trained models to predict delirium upon ICU admission (ADM) and at 24 h (24H) after ICU admission by using logistic regression (LR), gradient boosted trees (GBT), and deep learning (DL) algorithms and compared the models' performance.MAIN RESULTS: Eight features were extracted from the eligible features to train the ADM models, including age, body mass index, medical history of dementia, postoperative intensive monitoring, elective surgery, pre-ICU hospital stays, and GCS score and initial respiratory rate upon ICU admission. In the ADM testing dataset, the incidence of ICU delirium occurred within 24 h and 48 h was 32.9% and 36.2%, respectively. The area under the receiver operating characteristic curve (AUROC) (0.858, 95% CI 0.835-0.879) and area under the precision-recall curve (AUPRC) (0.814, 95% CI 0.780-0.844) for the ADM GBT model were the highest. The Brier scores of the ADM LR, GBT, and DL models were 0.149, 0.140, and 0.145, respectively. The AUROC (0.931, 95% CI 0.911-0.949) was the highest for the 24H DL model and the AUPRC (0.842, 95% CI 0.792-0.886) was the highest for the 24H LR model.CONCLUSION: Our early prediction models based on data obtained upon ICU admission could achieve good performance in predicting delirium occurred within 48 h after ICU admission. Our 24-h models can improve delirium prediction for patients discharged >1 day after ICU admission.

anesthesiology
A Predictive Model for Delirium in Hospitalized Elderly Medical Patients Based on Admission Characteristics

Sharon K. Inouye

DOI: https://doi.org/10.7326/0003-4819-119-6-199309150-00005

IF: 39.2

1993-09-15

Annals of Internal Medicine

Abstract:OBJECTIVE: To prospectively develop and validate a predictive model for the occurrence of new delirium in hospitalized elderly medical patients based on characteristics present at admission.DESIGN: Two prospective cohort studies done in tandem.SETTING: University teaching hospital.PATIENTS: The development cohort included 107 hospitalized general medical patients 70 years or older who did not have dementia or delirium at admission. The validation cohort included 174 comparable patients.MEASUREMENTS: Patients were assessed daily for delirium using a standardized, validated instrument. The predictive model developed in the initial cohort was then validated in a separate cohort of patients.RESULTS: Delirium developed in 27 of 107 patients (25%) in the development cohort. Four independent baseline risk factors for delirium were identified using proportional hazards analysis: These included vision impairment (adjusted relative risk, 3.5; 95% Cl, 1.2 to 10.7); severe illness (relative risk, 3.5; Cl, 1.5 to 8.2); cognitive impairment (relative risk, 2.8; Cl, 1.2 to 6.7); and a high blood urea nitrogen/creatinine ratio (relative risk, 2.0; Cl, 0.9 to 4.6). A risk stratification system was developed by assigning 1 point for each risk factor present. Rates of delirium for low- (0 points), intermediate- (1 to 2 points), and high-risk (3 to 4 points) groups were 9%, 23%, and 83% (P < 0.0001), respectively. The corresponding rates in the validation cohort, in which 29 of 174 patients (17%) developed delirium, were 3%, 16%, and 32% (P < 0.002). The rates of death or nursing home placement, outcomes potentially related to delirium, were 9%, 16%, and 42% (P = 0.02) in the development cohort and 3%, 14%, and 26% (P = 0.007) in the validation cohort.CONCLUSIONS: Delirium among elderly hospitalized patients is common, and a simple predictive model based on four risk factors can be used at admission to identify elderly persons at the greatest risk.

medicine, general & internal
Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Ryoung-Eun Ko,Jihye Lee,Sungeun Kim,Joong Hyun Ahn,Soo Jin Na,Jeong Hoon Yang

DOI: https://doi.org/10.1016/j.rec.2023.12.007

Abstract:Introduction and objectives: Delirium, recognized as a crucial prognostic factor in the cardiac intensive care unit (CICU), has evolved in response to the changing demographics among critically ill cardiac patients. This study aimed to create a predictive model for delirium for patients in the CICU. Methods: This study included consecutive patients admitted to the CICU of the Samsung Medical Center. To assess the candidate variables for the model: we applied the following machine learning methods: random forest, extreme gradient boosting, partial least squares, and Plmnet-elastic.net. After selecting relevant variables, we performed a logistic regression analysis to derive the model formula. Internal validation was conducted using 100-repeated hold-out validation. Results: We analyzed 2774 patients, 677 (24.4%) of whom developed delirium in the CICU. Machine learning-based models showed good predictive performance. Clinically significant and frequently important predictors were selected to construct a delirium prediction scoring model for CICU patients. The model included albumin level, international normalized ratio, blood urea nitrogen, white blood cell count, C-reactive protein level, age, heart rate, and mechanical ventilation. The model had an area under the receiver operating characteristics curve (AUROC) of 0.861 (95%CI, 0.843-0.879). Similar results were obtained in internal validation with 100-repeated cross-validation (AUROC, 0.854; 95%CI, 0.826-0.883). Conclusions: Using variables frequently ranked as highly important in four machine learning methods, we created a novel delirium prediction model. This model could serve as a useful and simple tool for risk stratification for the occurrence of delirium at the patient's bedside in the CICU.
Derivation and validation of a prediction rule for sedative-associated delirium during acute respiratory failure requiring mechanical ventilation

Niall T Prendergast,Chukwudi A Onyemekwu,Kelly M Potter,Christopher A Franz,Georgios D Kitsios,Bryan J McVerry,Pratik P Pandharipande,E Wes Ely,Timothy D Girard

DOI: https://doi.org/10.1101/2024.09.30.24314628

2024-10-01

Abstract:Abstract Background: Delirium during acute respiratory failure is common and morbid. Pharmacologic sedation is a major risk factor for delirium, but some sedation is often necessary for the provision of safe care of mechanically ventilated patients. A simple, transparent model that predicts sedative-associated delirium in mechanically ventilated ICU patients could be used to guide decisions about personalized sedation. Research Question: Can the risk of sedative-associated delirium be estimated in mechanically-ventilated ICU patients? Study Design and Methods: Using the subset of patients in a previously-published ICU cohort who received mechanical ventilation, we performed backward stepwise logistic regression to derive a model predictive of sedative-associated delirium. We validated this model internally using hundredfold bootstrapping. We then validated this model externally in a separate prospective cohort of mechanically ventilated ICU patients. Results: 836 patients comprised the derivation cohort. Backwards stepwise regression produced a model with age, BMI, sepsis, SOFA, malignancy, COPD, stroke, sex, and doses of sedatives (opioids, propofol, and/or benzodiazepines) as predictors of sedative-associated delirium. The model had very good discriminative power, with an area under the receiver-operator curve (AUROC) of 0.83. Internal validation via bootstrapping showed preserved discriminatory function with an AUROC of 0.81 and graphical evidence of good calibration. External validation in a separate set of 340 patients showed good discrimination, with AUROC of 0.70. Interpretation: Sedative-associated delirium during acute respiratory failure requiring mechanical ventilation can be predicted using a simple, transparent model, which can now be validated in a prospective study.

Intensive Care and Critical Care Medicine
Nomogram Models for Predicting Delirium of Patients in Emergency Intensive Care Unit: A Retrospective Cohort Study

Zheng-hai Bai,Li Zhang,Honghong Pei,Yu Shi,Ming Zhang,Hai Wang,Xiaoyan Shi

DOI: https://doi.org/10.2147/IJGM.S353318

IF: 2.145

2022-04-01

International Journal of General Medicine

Abstract:Background Intensive care unit (ICU) delirium is one of the most common clinical syndromes that results in many adverse events that affect patients, families, and hospitals. To date, there has been no tool for effectively predicting the occurrence of delirium in emergency intensive care unit (EICU) patients. Methods We conducted a retrospective cohort study and constructed a prediction model for 319 patients in EICU, who met our inclusion criteria. We analyzed the relationship between patients’ clinical data within 24 hours of admission and delirium, applied univariate and multivariate logistic regression analyses to select the most relevant variables for construction of nomogram models, then applied bootstrapping for internal validation. Results A total of five variables, namely stomach and urinary tubes, as well as sedative, mechanical ventilation and APACHE-II scores, were selected for model construction. We generated a total of five sets of models (three sets of construction models and two sets of internal verification models), with similar predictive value. The optimal model was selected, and together with the 5 variables used to construct a nomogram. The AUC of the MFP model in all patients was 0.76 (0.70, 0.82), whereas that in non-elderly patients (<60 years old) for the full model was 0.83 (0.74, 0.91). In elderly patients (≥60 years old), the AUC of the MFP model was 0.82 (0.73, 0.91). Conclusion Overall, the five-marker-based prognostic tool, established herein, can effectively predict the occurrence of delirium in EICU patients.

Medicine
Development and validation of risk-stratification delirium prediction model for critically ill patients

Bao-hua Wei,Chen-ming Dong,Hang Du,Yu Chen,Xue-ni Chang

DOI: https://doi.org/10.1097/MD.0000000000007543

IF: 1.6

2017-07-01

Medicine

Abstract:Abstract The objective is to develop a model based on risk stratification to predict delirium among adult critically ill patients and whether early intervention could be provided for high-risk patients, which could reduce the incidence of delirium. We designed a prospective, observational, single-center study. We examined 11 factors, including age, APACHE-II score, coma, emergency operation, mechanical ventilation (MV), multiple trauma, metabolic acidosis, history of hypertension, delirium and dementia, and application of Dexmedetomidine Hydrochloride. Confusion assessment method for the intensive care unit (CAM-ICU) was performed to screen patients during their ICU stay. Multivariate logistic regression analysis was used to develop the model, and we assessed the predictive ability of the model by using the area under the receiver operating characteristics curve (AUROC). From May 17, 2016 to September 25, 2016, 681 consecutive patients were screened, 61 of whom were excluded. The most frequent reason for exclusion was sustained coma 30 (4.4%), followed by a length of stay in the ICU < 24 hours 18 (2.6%) and delirium before ICU admission 13 (1.9%). Among the remaining 620 patients (including 162 nervous system disease patients), 160 patients (25.8%) developed delirium, and 64 (39.5%) had nervous system disease. The mean age was 55 ± 18 years old, the mean APACHE-II score was 16 ± 4, and 49.2% of them were male. Spearman analysis of nervous system disease and incidence of delirium showed that the correlation coefficient was 0.186 (P < .01). We constructed a prediction model that included 11 risk factors. The AUROC was 0.78 (95% CI 0.72–0.83). We developed the model using 11 related factors to predict delirium in critically ill patients and further determined that prophylaxis with Dexmedetomidine Hydrochloride in delirious ICU patients was beneficial. Patients who suffer from nervous system disease are at a higher incidence of delirium, and corresponding measures should be used for prevention. Trial registration: ChiCTR-OOC-16008535.

Medicine
Prediction of Delirium in Critically Ill Patients with Elevated C-reactive Protein

Zhongheng Zhang,Lifei Pan,Hongsheng Deng,Hongying Ni,Xiao Xu

DOI: https://doi.org/10.1016/j.jcrc.2013.09.002

IF: 4.298

2014-01-01

Journal of Critical Care

Abstract:Background and Purpose: Delirium is thought to be associated with systemic inflammatory response. However, its association with the most widely used inflammatory biomarker C-reactive protein (CRP) has not been well established. We aimed to examine whether CRP on intensive care unit (ICU) entry was associated with subsequent development of delirium.Design and Setting: This prospective observational study was conducted in a mixed 24-bed ICU in a tertiary teaching hospital.Methods: All patients admitted to the ICU from February 2011 to June 2012 were screened for eligibility. Demographic data and clinical characteristics of included patients were recorded. Patients were screened for the presence of delirium by using the tool Confusion Assessment Method for the ICU (CAM-ICU). C-reactive protein was obtained on ICU entry and 24 hours thereafter. Eligible patients were followed up for 28 days or until death. Univariate and multivariate analyses were performed to evaluate independent risk factors for delirium. Clinical outcome included the length of stay (LOS) in the ICU, 28-day mortality, and duration of mechanical ventilation. Two-tailed P < .05 was considered statistically significant.Results: A total of 223 patients were included during study period. In univariate analysis, patients with delirium showed significantly higher CRP values than those without (120.5 vs 57.5 mg/L; P = .0001). By adjusting for confounding variables (including age, sex, Acute Physiology and Chronic Health Evaluation II, intubation, living alone, physical restraint, alcohol drinking, smoking, type of medical condition, and hospital LOS before ICU admission) in logistic regression model, CRP remained an independent predictor of delirium (odds ratio, 1.07; 95% confidence interval, 1.01-1.15). As compared with nondelirious patients, those with delirium showed longer LOS in ICU (13 vs 5 days; P < .001) and duration of mechanical ventilation (6 vs 1 days; P < .001). An increase in CRP greater than 8.1 mg/L within 24 hours was associated with 4-fold increase in the risk of delirium (odds ratio: 4.47, 95% confidence interval, 1.28-15.60).Conclusion: C-reactive protein measured on ICU entry and its changes within 24 hours are risk indicators of delirium. Further studies exploring the treatment of delirium according to CRP levels are warranted. (C) 2014 Elsevier Inc. All rights reserved.
Impact of delirium on clinical outcome in critically ill patients: a meta-analysis.

Zhongheng Zhang,Lifei Pan,Hongying Ni

DOI: https://doi.org/10.1016/j.genhosppsych.2012.11.003

IF: 7.587

2013-01-01

General Hospital Psychiatry

Abstract:Delirium is prevalent in the intensive care unit (ICU) and has been associated with negative clinical outcomes. However, a quantitative and systematic assessment of published studies has not been conducted.Meta-analysis of clinical observational studies was performed to investigate the association between delirium and clinical outcomes.Relevant studies were identified by investigators from databases including Medline, Embase, OVID and EBSCO from inception to May 2012. Studies that reported the association of delirium with clinical outcomes in critical care setting were included.Data were extracted independently by reviewers and summary effects were obtained using random effects model.Of the 16 studies included, 14 studies involving 5891 patients reported data on mortality, and delirious patients had higher mortality rate than non-delirious patients (odds ratio [OR]: 3.22; 95% confidence interval [CI]: 2.30-4.52). Delirious patients had higher rate of complications (OR: 6.5; 95% CI: 2.7-15.6), and were more likely to be discharged to skilled placement (OR: 2.59; 95% CI: 1.59-4.21). Furthermore, patients with delirium had longer length of stay in both ICU (weighted mean difference [WMD]: 7.32 days; 95% CI: 4.63-10.01) and hospital (WMD: 6.53 days; 95% CI: 3.03-10.03), and they spent more time on mechanical ventilation (WMD: 7.22 days; 95% CI: 5.15-9.29).Delirium in critically ill patients is associated with higher mortality rate, more complications, longer duration of mechanical ventilation, and longer length of stay in ICU and hospital.
Development of a machine learning-based prediction model for sepsis-associated delirium in the intensive care unit

Yang Zhang,Juanjuan Hu,Tianfeng Hua,Jin Zhang,Zhongheng Zhang,Min Yang

DOI: https://doi.org/10.1038/s41598-023-38650-4

IF: 4.6

2023-08-06

Scientific Reports

Abstract:Septic patients in the intensive care unit (ICU) often develop sepsis-associated delirium (SAD), which is strongly associated with poor prognosis. The aim of this study is to develop a machine learning-based model for the early prediction of SAD. Patient data were extracted from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database and the eICU Collaborative Research Database (eICU-CRD). The MIMIC-IV data were divided into a training set and an internal validation set, while the eICU-CRD data served as an external validation set. Feature variables were selected using least absolute shrinkage and selection operator regression, and prediction models were built using logistic regression, support vector machines, decision trees, random forests, extreme gradient boosting (XGBoost), k-nearest neighbors and naive Bayes methods. The performance of the models was evaluated in the validation set. The model was also applied to a group of patients who were not assessed or could not be assessed for delirium. The MIMIC-IV and eICU-CRD databases included 14,620 and 1723 patients, respectively, with a median time to diagnosis of SAD of 24 and 30 h. Compared with Non-SAD patients, SAD patients had higher 28-days ICU mortality rates and longer ICU stays. Among the models compared, the XGBoost model had the best performance and was selected as the final model (internal validation area under the receiver operating characteristic curves (AUROC) = 0.793, external validation AUROC = 0.701). The XGBoost model outperformed other models in predicting SAD. The establishment of this predictive model allows for earlier prediction of SAD compared to traditional delirium assessments and is applicable to patients who are difficult to assess with traditional methods.

multidisciplinary sciences
Predicting delirium and the effects of medications in hospitalized COVID-19 patients using machine learning: A retrospective study within the Korean Multidisciplinary Cohort for Delirium Prevention (KoMCoDe)

So Hee Lee,Hyun Jung Hur,Sung Nyun Kim,Jang Ho Ahn,Du Hyun Ro,Arum Hong,Hye Yoon Park,Pyoeng Gyun Choe,Back Kim,Hye Youn Park

DOI: https://doi.org/10.1177/20552076231223811

2024-01-01

Digital Health

Abstract:Objective Delirium is commonly reported from the inpatients with Coronavirus disease 2019 (COVID-19) infection. As delirium is closely associated with adverse clinical outcomes, prediction and prevention of delirium is critical. We developed a machine learning (ML) model to predict delirium in hospitalized patients with COVID-19 and to identify modifiable factors to prevent delirium. Methods The data set (n = 878) from four medical centers was constructed. Total of 78 predictors were included such as demographic characteristics, vital signs, laboratory results and medication, and the primary outcome was delirium occurrence during hospitalization. For analysis, the extreme gradient boosting (XGBoost) algorithm was applied, and the most influential factors were selected by recursive feature elimination. Among the indicators of performance for ML model, the area under the curve of the receiver operating characteristic (AUROC) curve was selected as the evaluation metric. Results Regarding the performance of developed delirium prediction model, the accuracy, precision, recall, F1 score, and the AUROC were calculated (0.944, 0.581, 0.421, 0.485, 0.873, respectively). The influential factors of delirium in this model included were mechanical ventilation, medication (antipsychotics, sedatives, ambroxol, piperacillin/tazobactam, acetaminophen, ceftriaxone, and propacetamol), and sodium ion concentration (all p < 0.05). Conclusions We developed and internally validated an ML model to predict delirium in COVID-19 inpatients. The model identified modifiable factors associated with the development of delirium and could be clinically useful for the prediction and prevention of delirium in COVID-19 inpatients.

public, environmental & occupational health,health care sciences & services,medical informatics,health policy & services

Prognostic Accuracy of Delirium Prediction Models.

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Research progress in the Delirium Risk Prediction Models of post-operative patients in ICU

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

ICU Delirium Prediction Models: A Systematic Review

Delirium risk prediction models for intensive care unit patients: A systematic review

Prediction models for postoperative delirium after cardiac surgery: Systematic review and critical appraisal

Evaluation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for the patients in the intensive care unit

Development and validation of delirium prediction models for noncardiac surgery patients

Delirium prediction in the ICU: designing a screening tool for preventive interventions

Utility of a prediction model for delirium in intensive care unit patients (PRE-DELIRIC) in mechanically ventilated patients with sepsis

Early prediction of delirium upon intensive care unit admission: Model development, validation, and deployment

A Predictive Model for Delirium in Hospitalized Elderly Medical Patients Based on Admission Characteristics

Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Derivation and validation of a prediction rule for sedative-associated delirium during acute respiratory failure requiring mechanical ventilation

Nomogram Models for Predicting Delirium of Patients in Emergency Intensive Care Unit: A Retrospective Cohort Study

Development and validation of risk-stratification delirium prediction model for critically ill patients

Prediction of Delirium in Critically Ill Patients with Elevated C-reactive Protein

Impact of delirium on clinical outcome in critically ill patients: a meta-analysis.

Development of a machine learning-based prediction model for sepsis-associated delirium in the intensive care unit

Predicting delirium and the effects of medications in hospitalized COVID-19 patients using machine learning: A retrospective study within the Korean Multidisciplinary Cohort for Delirium Prevention (KoMCoDe)