Predicting delirium in older non-intensive care unit inpatients: development and validation of the DELIrium risK Tool (DELIKT)

Csajka, Chantal

DOI: https://doi.org/10.1007/s11096-023-01566-0

IF: 2.305

2023-04-16

International Journal of Clinical Pharmacy

Abstract:Effective delirium prevention could benefit from automatic risk stratification of older inpatients using routinely collected clinical data.

pharmacology & pharmacy

What problem does this paper attempt to address?

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Xiangping Chen,Yuewen Lao,Yi Zhang,Lijie Qiao,Yiyu Zhuang

DOI: https://doi.org/10.21037/apm-20-1183

2020-01-01

Annals of Palliative Medicine

Abstract:BACKGROUND:An emerging approach to prevent delirium in an intensive care unit is the use of risk prediction models. At present, there is no scientific comparison of the predictive effect of the prediction model. This systematic review and meta-analysis aimed to compare the performance of available delirium risk prediction models for intensive care units.METHODS:As of June 1st, 2019, articles on delirium prediction models of the intensive care patients were searched in the Cochrane Library, PubMed, Embase, Web of Science, CINAHL, ProQuest, and four Chinese databases. Studies describing the development or validation of risk prediction models for predicting delirium in ICU patients were included. The Prediction model Risk of Bias Assessment Tool (PROBAST) was used to assess the quality of included studies. A meta-analysis of the predictive performance was performed using the forest plot package in R3.6.1.RESULTS:A total of 21 studies with 14 models were included in this article. PRE-DELIRIC, E-PREDELIRIC, and recalibrated PRE-DELIRIC model were the most popular models, which had been externally validated in at least two studies. The pooled area under the receiver operator characteristic curve (AUC) were 0.844 (95% CI: 0.793-0.896), 0.763 (95% CI: 0.680-0.846) and 0.776 (95% CI: 0.738-0.813) respectively. Most of the other models were with C-statistics above 0.7.CONCLUSIONS:The E-PRE-DELIRIC model, PRE-DELIRIC model, or both are recommended to predict ICU delirium risk. However, the recommendation should be considered with caution because of substantial heterogeneity. The protocol was registered with PROSPERO (CRD42019130802).
Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Wen Gao,Yuping Zhang,Jingfen Jin

DOI: https://doi.org/10.1111/nicc.12674

2022-01-01

Nursing in Critical Care

Abstract:Background The early prediction model for delirium in intensive care units (ICUs)-E-PRE-DELIRIC-has been created to predict delirium development during the length of stay in ICUs. However, there have been few early predictive models for delirium in the cardiac surgical ICU (CSICU), and the predictive ability of the E-PRE-DELIRIC among patients following cardiac surgeries is still unknown. Aims and objectives To validate the performance of E-PRE-DELIRIC in CSICU. Design A retrospective cohort study. Methods Data were retrospectively extracted from the electronic records for patients admitted in CSICU from January 2018 to December 2018 in a tertiary teaching hospital in China. Adult patients were included following the criteria of the E-PRE-DELIRIC model. Predictors, including age, history of cognitive impairment, history of alcohol abuse, urgent admission, use of corticosteroids, respiratory failure, blood urea nitrogen, and mean arterial pressure, at the time of ICU admission were retrieved, and delirium was assessed twice a day using the Confusion Assessment Method for the ICU. The performance of the E-PRE-DELIRIC model was evaluated by area under receiver operator characteristic curve, precision-recall curve (AUPRC), Hosmer-Lemeshow (HL) test, and calibration belt. Results Of the 725 patients included, 120 (16.6%) developed delirium. The AUROC was 0.54 (95% confidence interval [CI], 0.48-0.59), and the AUPRC was 0.18 (95% CI, 0.12-0.20). The HL test showed a significant difference between predicted probability and delirium occurrence (chi(2) = 17.326, P = .027), and the overestimation chance of the E-PRE-DELIRIC score was 0.24 to 0.43. Conclusion The E-PRE-DELIRIC model has poor-to-fair predictive value in this study; thus, its application among the CSICU patients is limited. Development of reliable and validated tools for early prediction of delirium in CSICU is required. Relevance to clinical practice Early prediction of delirium risk at CSICU admission is of vital importance and could provide timely information to caregivers. However, the E-PRE-DELIRIC model should be applied cautiously in the CSICU because of the significant probability of over-estimating the risk of developing delirium.
Development and validation of a delirium risk assessment tool in older patients admitted to the Emergency Department Observation Unit

A. Zucchelli,R. Apuzzo,C. Paolillo,V. Prestipino,S. De Bianchi,G. Romanelli,A. Padovani,A. Marengoni,G. Bellelli

DOI: https://doi.org/10.1007/s40520-021-01792-4

2021-02-09

Aging Clinical and Experimental Research

Abstract:Abstract Background Delirium is frequent though undetected in older patients admitted to the Emergency Department (ED). Aims To develop and validate a delirium risk assessment tool for older persons admitted to the ED Observation Unit (OU). Methods We used data from two samples of 65 + year-old patients, one admitted to the ED of Brescia Hospital ( n = 257) and one to the ED of Desio Hospital ( n = 107), Italy. Data from Brescia were used as training sample, those collected in Desio as testing one. Delirium was assessed using the 4AT and patients’ characteristic were retrieved from medical charts. Variables found to be associated with delirium in the training sample were tested for the creation of a delirium risk assessment tool. The resulting tool’s performances were assessed in the testing subsample. Results Of all possible scores tested, the combination with the highest discriminative ability in the training sample included: age ≥ 75 years, dementia diagnosis, chronic use of neuroleptics, and hearing impairment. The delirium score exhibited an AUC of 0.874 and 0.893 in the training and testing samples, respectively. For a 1-point increase in the score, the odds of delirium increased more than twice in both samples. Discussion We propose a delirium risk assessing tool that includes variables that can be easily collected at ED admission and that can be calculated rapidly. Conclusion A risk assessment tool could help improving delirium detection in older persons referring to ED.

geriatrics & gerontology,gerontology
Delirium prediction in the ICU: designing a screening tool for preventive interventions

Anirban Bhattacharyya,Seyedmostafa Sheikhalishahi,Heather Torbic,Wesley Yeung,Tiffany Wang,Jennifer Birst,Abhijit Duggal,Leo Anthony Celi,Venet Osmani

DOI: https://doi.org/10.1093/jamiaopen/ooac048

2022-04-06

JAMIA Open

Abstract:Abstract Introduction Delirium occurrence is common and preventive strategies are resource intensive. Screening tools can prioritize patients at risk. Using machine learning, we can capture time and treatment effects that pose a challenge to delirium prediction. We aim to develop a delirium prediction model that can be used as a screening tool. Methods From the eICU Collaborative Research Database (eICU-CRD) and the Medical Information Mart for Intensive Care version III (MIMIC-III) database, patients with one or more Confusion Assessment Method-Intensive Care Unit (CAM-ICU) values and intensive care unit (ICU) length of stay greater than 24 h were included in our study. We validated our model using 21 quantitative clinical parameters and assessed performance across a range of observation and prediction windows, using different thresholds and applied interpretation techniques. We evaluate our models based on stratified repeated cross-validation using 3 algorithms, namely Logistic Regression, Random Forest, and Bidirectional Long Short-Term Memory (BiLSTM). BiLSTM represents an evolution from recurrent neural network-based Long Short-Term Memory, and with a backward input, preserves information from both past and future. Model performance is measured using Area Under Receiver Operating Characteristic, Area Under Precision Recall Curve, Recall, Precision (Positive Predictive Value), and Negative Predictive Value metrics. Results We evaluated our results on 16 546 patients (47% female) and 6294 patients (44% female) from eICU-CRD and MIMIC-III databases, respectively. Performance was best in BiLSTM models where, precision and recall changed from 37.52% (95% confidence interval [CI], 36.00%–39.05%) to 17.45 (95% CI, 15.83%–19.08%) and 86.1% (95% CI, 82.49%–89.71%) to 75.58% (95% CI, 68.33%–82.83%), respectively as prediction window increased from 12 to 96 h. After optimizing for higher recall, precision and recall changed from 26.96% (95% CI, 24.99%–28.94%) to 11.34% (95% CI, 10.71%–11.98%) and 93.73% (95% CI, 93.1%–94.37%) to 92.57% (95% CI, 88.19%–96.95%), respectively. Comparable results were obtained in the MIMIC-III cohort. Conclusions Our model performed comparably to contemporary models using fewer variables. Using techniques like sliding windows, modification of threshold to augment recall and feature ranking for interpretability, we addressed shortcomings of current models.
Evaluation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for the patients in the intensive care unit

Gabrielė Linkaitė,Mantas Riauka,Ignė Bunevičiūtė,Saulius Vosylius

DOI: https://doi.org/10.6001/actamedica.v25i1.3699

2018-05-14

Acta medica Lituanica

Abstract:Introduction. Delirium not only compromises patient care, but is also associated with poorer outcomes: increased duration of mechanical ventilation, higher mortality, and greater long-term cognitive dysfunction. The PRE-DELIRIC model is a tool used to calculate the risk of the development of delirium. The classification of the patients into groups by risk allows efficient initiation of preventive measures. The goal of this study was to validate the PRE-DELIRIC model using the CAM-ICU (The Confusion Assessment Method for the Intensive Care Unit) method for the diagnosis of delirium. Materials and methods. Patients admitted to the University Hospital of Vilnius during February 2015 were enrolled. Every day, data were collected for APACHE-II and PRE-DELIRIC scores. Out of 167 patients, 38 (23%) were included and screened using the CAM-ICU method within 24 hours of admission to the ICU. We defined patients as having delirium when they had at least one positive CAM-ICU screening or haloperidol administration due to sedation. To validate the PRE-DELIRIC model, we calculated the area under receiver operating characteristic curve. Results. The mean age of the patients was 69.2 ± 17.2 years, 19 (50%) were male, APACHE-II mean score 18.0 ± 7.4 points. Delirium was diagnosed in 22 (58%) of 38 patients. Data used for validation of the PRE-DELIRIC model resulted in an area under the curve of 0.713 (p < 0.05, 95% CI 0.539–0.887); sensitivity and specificity for the patients with 20% risk were, accordingly, 77.3% and 50%; 40% risk – 45.5% and 81.3%, 60% – 36.4%, and 87.5%. Conclusions. The PRE-DELIRIC model predicted delirium in the patients within 24 hours of admission to the ICU. Preventive therapy could be efficiently targeted at high-risk patients if both of the methods are to be implemented.
Machine learning-based delirium prediction in surgical in-patients: a prospective validation study

Stefanie Jauk,Diether Kramer,Stefan Sumerauer,Sai Pavan Kumar Veeranki,Michael Schrempf,Paul Puchwein

DOI: https://doi.org/10.1093/jamiaopen/ooae091

2024-09-17

JAMIA Open

Abstract:Objective: Delirium is a syndrome that leads to severe complications in hospitalized patients, but is considered preventable in many cases. One of the biggest challenges is to identify patients at risk in a hectic clinical routine, as most screening tools cause additional workload. The aim of this study was to validate a machine learning (ML)-based delirium prediction tool on surgical in-patients undergoing a systematic assessment of delirium. Materials and methods: 738 in-patients of a vascular surgery, a trauma surgery and an orthopedic surgery department were screened for delirium using the DOS scale twice a day over their hospital stay. Concurrently, delirium risk was predicted by the ML algorithm in real-time for all patients at admission and evening of admission. The prediction was performed automatically based on existing EHR data and without any additional documentation needed. Results: 103 patients (14.0%) were screened positive for delirium using the DOS scale. Out of them, 85 (82.5%) were correctly identified by the ML algorithm. Specificity was slightly lower, detecting 463 (72.9%) out of 635 patients without delirium. The AUROC of the algorithm was 0.883 (95% CI, 0.8523-0.9147). Discussion: In this prospective validation study, the implemented machine-learning algorithm was able to detect patients with delirium in surgical departments with high discriminative performance. Conclusion: In future, this tool or similar decision support systems may help to replace time-intensive screening tools and enable efficient prevention of delirium.
Clinical Prediction Models for Hospital-Induced Delirium Using Structured and Unstructured Electronic Health Record Data: Protocol for a Development and Validation Study

Sarah E Ser,Kristen Shear,Urszula A Snigurska,Mattia Prosperi,Yonghui Wu,Tanja Magoc,Ragnhildur I Bjarnadottir,Robert J Lucero

DOI: https://doi.org/10.2196/48521

2023-11-09

Abstract:Background: Hospital-induced delirium is one of the most common and costly iatrogenic conditions, and its incidence is predicted to increase as the population of the United States ages. An academic and clinical interdisciplinary systems approach is needed to reduce the frequency and impact of hospital-induced delirium. Objective: The long-term goal of our research is to enhance the safety of hospitalized older adults by reducing iatrogenic conditions through an effective learning health system. In this study, we will develop models for predicting hospital-induced delirium. In order to accomplish this objective, we will create a computable phenotype for our outcome (hospital-induced delirium), design an expert-based traditional logistic regression model, leverage machine learning techniques to generate a model using structured data, and use machine learning and natural language processing to produce an integrated model with components from both structured data and text data. Methods: This study will explore text-based data, such as nursing notes, to improve the predictive capability of prognostic models for hospital-induced delirium. By using supervised and unsupervised text mining in addition to structured data, we will examine multiple types of information in electronic health record data to predict medical-surgical patient risk of developing delirium. Development and validation will be compliant to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. Results: Work on this project will take place through March 2024. For this study, we will use data from approximately 332,230 encounters that occurred between January 2012 to May 2021. Findings from this project will be disseminated at scientific conferences and in peer-reviewed journals. Conclusions: Success in this study will yield a durable, high-performing research-data infrastructure that will process, extract, and analyze clinical text data in near real time. This model has the potential to be integrated into the electronic health record and provide point-of-care decision support to prevent harm and improve quality of care. International registered report identifier (irrid): DERR1-10.2196/48521.
Development and validation of risk-stratification delirium prediction model for critically ill patients

Bao-hua Wei,Chen-ming Dong,Hang Du,Yu Chen,Xue-ni Chang

DOI: https://doi.org/10.1097/MD.0000000000007543

IF: 1.6

2017-07-01

Medicine

Abstract:Abstract The objective is to develop a model based on risk stratification to predict delirium among adult critically ill patients and whether early intervention could be provided for high-risk patients, which could reduce the incidence of delirium. We designed a prospective, observational, single-center study. We examined 11 factors, including age, APACHE-II score, coma, emergency operation, mechanical ventilation (MV), multiple trauma, metabolic acidosis, history of hypertension, delirium and dementia, and application of Dexmedetomidine Hydrochloride. Confusion assessment method for the intensive care unit (CAM-ICU) was performed to screen patients during their ICU stay. Multivariate logistic regression analysis was used to develop the model, and we assessed the predictive ability of the model by using the area under the receiver operating characteristics curve (AUROC). From May 17, 2016 to September 25, 2016, 681 consecutive patients were screened, 61 of whom were excluded. The most frequent reason for exclusion was sustained coma 30 (4.4%), followed by a length of stay in the ICU < 24 hours 18 (2.6%) and delirium before ICU admission 13 (1.9%). Among the remaining 620 patients (including 162 nervous system disease patients), 160 patients (25.8%) developed delirium, and 64 (39.5%) had nervous system disease. The mean age was 55 ± 18 years old, the mean APACHE-II score was 16 ± 4, and 49.2% of them were male. Spearman analysis of nervous system disease and incidence of delirium showed that the correlation coefficient was 0.186 (P < .01). We constructed a prediction model that included 11 risk factors. The AUROC was 0.78 (95% CI 0.72–0.83). We developed the model using 11 related factors to predict delirium in critically ill patients and further determined that prophylaxis with Dexmedetomidine Hydrochloride in delirious ICU patients was beneficial. Patients who suffer from nervous system disease are at a higher incidence of delirium, and corresponding measures should be used for prevention. Trial registration: ChiCTR-OOC-16008535.

Medicine
Using Machine Learning and Electronic Health Records to Identify Neuropsychiatric Risk Scores for Delirium in ICU and General Hospital Settings

Mariam Heikal,Halim Saad,Pia Maria Ghanime,Tarek Bou Dargham,Maya Bizri,Firas Kobeissy,Wassim El Hajj,Farid Talih

DOI: https://doi.org/10.2147/NDT.S479756

2024-10-02

Abstract:Objective: Delirium is a common and acute neuropsychiatric syndrome that requires timely intervention to prevent its associated morbidity and mortality. Yet, its diagnosis and symptoms are often overlooked due to its variable clinical presentation and fluctuating nature. Thus, in this study, we address the barriers to delirium diagnosis by utilizing a machine learning-based predictive algorithm for incident delirium that relies on archived electronic health records (EHRs) data. Methods: We used the Medical Information Mart for Intensive Care (MIMIC) database to create a detailed dataset for identifying delirium in intensive care unit (ICU) patients. Our approach involved training machine learning models on this dataset to pinpoint critical clinical features for delirium detection. These features were then refined and applied to non-ICU patients using EHRs from the American University of Beirut Medical Center (AUBMC). Results: Our study assessed machine learning models like Extreme Gradient Boosting (XGBoost), Categorical Boosting (CatBoost), Classification and Regression Trees (CART), Random Forest (RF), Neural Oblivious Decision Ensembles (NODE), and Logistic Regression (LR), highlighting superior delirium detection in diverse clinical settings. The CatBoost model excelled in ICU environments with an F1 Score of 89.2%, while XGBoost performed best in general hospital settings with a 75.4% F1 Score. Interpretations using Tabular Local Interpretable Model-agnostic Explanations (LIME) revealed critical indicators such as prothrombin time and hematocrit levels, enhancing model transparency and clinical applicability. These clinical insights help differentiate the delirium predictors between ICU patients, who are often sensitive to various factors. Conclusion: The proposed predictive algorithm improves delirium detection rates and streamlines efficiency in hospital electronic systems, thereby enabling prompt interventions to prevent delirium progression and associated complications. The clinical indicators for delirium that we identified in general hospital settings and ICU can greatly help healthcare professionals identify potential causes of delirium and reduce misdiagnosis.
Occurrence and predictors of delirium in critically ill older patients: a prospective cohort study

Rita Martins,Sónia Martins,Raquel Correia,Elika Pinho,Cristiana Paulo,Maria João Silva,Ana Teixeira,Liliana Fontes,Luís Lopes,José Artur Paiva,Luís Filipe Azevedo,Lia Fernandes

DOI: https://doi.org/10.1097/j.pbj.0000000000000240

2023-12-13

Abstract:Objectives: This study aims to analyze the occurrence of delirium in critically ill older patients and to identify predictors of delirium. Methods: This prospective study included critically ill older patients admitted into level II units of Intensive Care Medicine Department of a University Hospital. Patients with Glasgow Coma Scale score ≤11, traumatic brain injury, terminal disease, history of psychosis, blindness/deafness, or inability to understanding/speaking Portuguese were excluded. The Confusion Assessment Method-Short Form (CAM-4) was used to assess the presence of delirium. Results: The final sample (n = 105) had a median age of 80 years, most being female (56.2%), widowed (49.5%), and with complete primary education (53%). Through CAM-4, 36.2% of the patients had delirium. The delirium group was more likely to have previous cognitive decline (48.6% vs 19.6%, P = .04) and severe dependency in instrumental activities of daily living (34.3% vs 14.8%, P = .032), comparing with patients without delirium. The final multiple logistic regression model explained that patients with previous cognitive decline presented a higher risk for delirium (odds ratio: 4.663, 95% confidence Interval: 1.055-20.599, P = .042). Conclusions: These findings corroborate previous studies, showing that cognitive decline is an independent predictor for delirium in older patients. This study is an important contribution for the knowledge regarding the predictors of delirium. The recognition of these factors will help to identify patients who are at high risk for this syndrome and implement early screening and prevention strategies. However, further studies with larger samples, recruited from other clinical settings as well as analyzing other potential factors for delirium, will be needed.
Adaptation and Validation of a Chart-Based Delirium Detection Tool for the ICU (CHART-DEL-ICU)

Karla D Krewulak,Carmen Hiploylee,E W Ely,Henry T Stelfox,Sharon K Inouye,Kirsten M Fiest

DOI: https://doi.org/10.1111/jgs.16987

Abstract:Objective: To adapt and validate a chart-based delirium detection tool for use in critically ill adults. Design: Validation study. Setting: Medical-surgical intensive care unit (ICU) in an academic hospital. Measurements: A chart-based delirium detection tool (CHART-DEL) was adapted for use in critically ill adults (CHART-DEL-ICU) and compared with prospective delirium assessments (i.e., clinical assessments (reference standard) by a research nurse trained by a neuropsychiatrist and routine delirium screening tools Confusion Assessment Method (CAM-ICU)) and (Intensive Care Delirium Screening Checklist (ICDSC)). The original CHART-DEL tool was adapted to include physician-reported ICDSC score (for probable delirium) and Richmond-Agitation Sedation Scale score (for altered level of consciousness and agitation). Two trained chart abstractors blinded to all delirium assessments manually abstracted delirium-related information from medical charts and electronic medical records and rated if delirium was present (four levels: uncertain, possible, probable, definite) or absent (no evidence). Results: Charts were manually abstracted for delirium-related information for 213 patients who were included in a prospective cohort study that included prospective delirium assessments. The CHART-DEL-ICU tool had excellent interrater reliability (kappa = 0.90). Compared to the reference standard, the sensitivity was 66.0% (95% CI = 59.3-72.3%) and specificity was 82.1% (95% CI = 78.0-85.7%), with a cut-point that included definite, probable, possible, and uncertain delirium. The AUC of the CHART-DEL-ICU alone is 74.1% (95% CI = 70.4-77.8%) compared with the addition of the CAM-ICU and ICDSC (CAM-ICU/CHART-DEL-ICU: 80.9% (95% CI = 77.8-83.9%), P = .01; ICDSC/CHART-DEL-ICU: 79.2% (95% CI = 75.9-82.6%), P = .03). Conclusion: A chart-based delirium detection tool has improved diagnostic accuracy when combined with routine delirium screening tools (CAM-ICU and ICDSC), compared to a chart-based method on its own. This presents a potential for retrospective detection of delirium from medical charts for research or to augment routine delirium screening methods to find missed cases of delirium.
A Predictive Model for Delirium in Hospitalized Elderly Medical Patients Based on Admission Characteristics

Sharon K. Inouye

DOI: https://doi.org/10.7326/0003-4819-119-6-199309150-00005

IF: 39.2

1993-09-15

Annals of Internal Medicine

Abstract:OBJECTIVE: To prospectively develop and validate a predictive model for the occurrence of new delirium in hospitalized elderly medical patients based on characteristics present at admission.DESIGN: Two prospective cohort studies done in tandem.SETTING: University teaching hospital.PATIENTS: The development cohort included 107 hospitalized general medical patients 70 years or older who did not have dementia or delirium at admission. The validation cohort included 174 comparable patients.MEASUREMENTS: Patients were assessed daily for delirium using a standardized, validated instrument. The predictive model developed in the initial cohort was then validated in a separate cohort of patients.RESULTS: Delirium developed in 27 of 107 patients (25%) in the development cohort. Four independent baseline risk factors for delirium were identified using proportional hazards analysis: These included vision impairment (adjusted relative risk, 3.5; 95% Cl, 1.2 to 10.7); severe illness (relative risk, 3.5; Cl, 1.5 to 8.2); cognitive impairment (relative risk, 2.8; Cl, 1.2 to 6.7); and a high blood urea nitrogen/creatinine ratio (relative risk, 2.0; Cl, 0.9 to 4.6). A risk stratification system was developed by assigning 1 point for each risk factor present. Rates of delirium for low- (0 points), intermediate- (1 to 2 points), and high-risk (3 to 4 points) groups were 9%, 23%, and 83% (P < 0.0001), respectively. The corresponding rates in the validation cohort, in which 29 of 174 patients (17%) developed delirium, were 3%, 16%, and 32% (P < 0.002). The rates of death or nursing home placement, outcomes potentially related to delirium, were 9%, 16%, and 42% (P = 0.02) in the development cohort and 3%, 14%, and 26% (P = 0.007) in the validation cohort.CONCLUSIONS: Delirium among elderly hospitalized patients is common, and a simple predictive model based on four risk factors can be used at admission to identify elderly persons at the greatest risk.

medicine, general & internal
Validation of two nurse-based screening tools for delirium in elderly patients in general medical wards

Manuela Bergjan,Max Zilezinski,Torsten Schwalbach,Christiana Franke,Hebun Erdur,Heinrich Jakob Audebert,Armin Hauß

DOI: https://doi.org/10.1186/s12912-020-00464-4

2020-07-31

Abstract:Background: Delirium is an acute disturbance characterized by fluctuating symptoms related to attention, awareness and recognition. Especially for elderly patients, delirium is frequently associated with high hospital costs and resource consumption, worse functional deterioration and increased mortality rates. Early recognition of risk factors and delirium symptoms enables medical staff to prevent or treat negative effects. Most studies examining screening instruments for delirium were conducted in intensive care units and surgical wards, and rarely in general medical wards. The aim of the study is to validate the Nursing Delirium Screening Scale (Nu-DESC) and the Delirium Observation Screening Scale (DOS) in general medical wards in a German tertiary care hospital, considering predisposing delirium risk factors in patients aged 65 and older. Methods: The prospective observational study including 698 patients was conducted between May and August 2018 in two neurological and one cardiology ward. During their shifts, trained nurses assessed all patients aged 65 or older for delirium symptoms using the Nu-DESC and the DOS. Delirium was diagnosed according to the DSM-5 criteria by neurologists. Patient characteristics and predisposing risk factors were obtained from the digital patient management system. Descriptive and bivariate statistics were computed. Results: The study determined an overall delirium occurrence rate of 9.0%. Regarding the DOS, sensitivity was 0.94, specificity 0.86, PPV 0.40 NPV 0.99 and regarding the Nu-DESC, sensitivity was 0.98, specificity 0.87, PPV 0.43, NPV 1.00. Several predisposing risk factors increased the probability of delirium: pressure ulcer risk OR: 17.3; falls risk OR: 14.0; immobility OR: 12.7; dementia OR: 5.38. Conclusions: Both screening instruments provided high accuracy for delirium detection in general medical wards. The Nu-DESC proved to be an efficient delirium screening tool that can be integrated into routine patient care. According to the study results, pressure ulcer risk, falls risk, and immobility were risk factors triggering delirium in most cases. Impaired mobility, as common risk factor of the before mentioned risks, is well known to be preventable through physical activity programmes.
Nomogram Models for Predicting Delirium of Patients in Emergency Intensive Care Unit: A Retrospective Cohort Study

Zheng-hai Bai,Li Zhang,Honghong Pei,Yu Shi,Ming Zhang,Hai Wang,Xiaoyan Shi

DOI: https://doi.org/10.2147/IJGM.S353318

IF: 2.145

2022-04-01

International Journal of General Medicine

Abstract:Background Intensive care unit (ICU) delirium is one of the most common clinical syndromes that results in many adverse events that affect patients, families, and hospitals. To date, there has been no tool for effectively predicting the occurrence of delirium in emergency intensive care unit (EICU) patients. Methods We conducted a retrospective cohort study and constructed a prediction model for 319 patients in EICU, who met our inclusion criteria. We analyzed the relationship between patients’ clinical data within 24 hours of admission and delirium, applied univariate and multivariate logistic regression analyses to select the most relevant variables for construction of nomogram models, then applied bootstrapping for internal validation. Results A total of five variables, namely stomach and urinary tubes, as well as sedative, mechanical ventilation and APACHE-II scores, were selected for model construction. We generated a total of five sets of models (three sets of construction models and two sets of internal verification models), with similar predictive value. The optimal model was selected, and together with the 5 variables used to construct a nomogram. The AUC of the MFP model in all patients was 0.76 (0.70, 0.82), whereas that in non-elderly patients (<60 years old) for the full model was 0.83 (0.74, 0.91). In elderly patients (≥60 years old), the AUC of the MFP model was 0.82 (0.73, 0.91). Conclusion Overall, the five-marker-based prognostic tool, established herein, can effectively predict the occurrence of delirium in EICU patients.

Medicine
Development and validation of an international preoperative risk assessment model for postoperative delirium

Benjamin T Dodsworth,Kelly Reeve,Lisa Falco,Tom Hueting,Behnam Sadeghirad,Lawrence Mbuagbaw,Nicolai Goettel,Nayeli Schmutz Gelsomino

DOI: https://doi.org/10.1093/ageing/afad086

2023-06-01

Age and Ageing

Abstract:Abstract Background Postoperative delirium (POD) is a frequent complication in older adults, characterised by disturbances in attention, awareness and cognition, and associated with prolonged hospitalisation, poor functional recovery, cognitive decline, long-term dementia and increased mortality. Early identification of patients at risk of POD can considerably aid prevention. Methods We have developed a preoperative POD risk prediction algorithm using data from eight studies identified during a systematic review and providing individual-level data. Ten-fold cross-validation was used for predictor selection and internal validation of the final penalised logistic regression model. The external validation used data from university hospitals in Switzerland and Germany. Results Development included 2,250 surgical (excluding cardiac and intracranial) patients 60 years of age or older, 444 of whom developed POD. The final model included age, body mass index, American Society of Anaesthesiologists (ASA) score, history of delirium, cognitive impairment, medications, optional C-reactive protein (CRP), surgical risk and whether the operation is a laparotomy/thoracotomy. At internal validation, the algorithm had an AUC of 0.80 (95% CI: 0.77–0.82) with CRP and 0.79 (95% CI: 0.77–0.82) without CRP. The external validation consisted of 359 patients, 87 of whom developed POD. The external validation yielded an AUC of 0.74 (95% CI: 0.68–0.80). Conclusions The algorithm is named PIPRA (Pre-Interventional Preventive Risk Assessment), has European conformity (ce) certification, is available at http://pipra.ch/ and is accepted for clinical use. It can be used to optimise patient care and prioritise interventions for vulnerable patients and presents an effective way to implement POD prevention strategies in clinical practice.

geriatrics & gerontology,gerontology
Development and Validation of an Electronic Health Record–Based Machine Learning Model to Estimate Delirium Risk in Newly Hospitalized Patients Without Known Cognitive Impairment

Andrew Wong,Albert T. Young,April S. Liang,Ralph Gonzales,Vanja C. Douglas,Dexter Hadley

DOI: https://doi.org/10.1001/jamanetworkopen.2018.1018

2018-08-03

JAMA Network Open

Abstract:Importance: Current methods for identifying hospitalized patients at increased risk of delirium require nurse-administered questionnaires with moderate accuracy.Objective: To develop and validate a machine learning model that predicts incident delirium risk based on electronic health data available on admission.Design, Setting, and Participants: Retrospective cohort study evaluating 5 machine learning algorithms to predict delirium using 796 clinical variables identified by an expert panel as relevant to delirium prediction and consistently available in electronic health records within 24 hours of admission. The training set comprised 14 227 adult patients with non-intensive care unit hospital stays and no delirium on admission who were discharged between January 1, 2016, and August 31, 2017, from UCSF Health, a large academic health institution. The test set comprised 3996 patients with hospital stays who were discharged between August 1, 2017, and November 30, 2017.Exposures: Patient demographic characteristics, diagnoses, nursing records, laboratory results, and medications available in electronic health records during hospitalization.Main Outcomes and Measures: Delirium was defined as a positive Nursing Delirium Screening Scale or Confusion Assessment Method for the Intensive Care Unit score. Models were assessed using the area under the receiver operating characteristic curve (AUC) and compared against the 4-point scoring system AWOL (age >79 years, failure to spell world backward, disorientation to place, and higher nurse-rated illness severity), a validated delirium risk-assessment tool routinely administered in this cohort.Results: The training set included 14 227 patients (5113 [35.9%] aged >64 years; 7335 [51.6%] female; 687 [4.8%] with delirium), and the test set included 3996 patients (1491 [37.3%] aged >64 years; 1966 [49.2%] female; 191 [4.8%] with delirium). In total, the analysis included 18 223 hospital admissions (6604 [36.2%] aged >64 years; 9301 [51.0%] female; 878 [4.8%] with delirium). The AWOL system achieved a baseline AUC of 0.678. The gradient boosting machine model performed best, with an AUC of 0.855. Setting specificity at 90%, the model had a 59.7% (95% CI, 52.4%-66.7%) sensitivity, 23.1% (95% CI, 20.5%-25.9%) positive predictive value, 97.8% (95% CI, 97.4%-98.1%) negative predictive value, and a number needed to screen of 4.8. Penalized logistic regression and random forest models also performed well, with AUCs of 0.854 and 0.848, respectively.Conclusions and Relevance: Machine learning can be used to estimate hospital-acquired delirium risk using electronic health record data available within 24 hours of hospital admission. Such a model may allow more precise targeting of delirium prevention resources without increasing the burden on health care professionals.

medicine, general & internal
Delirium Assessment Tools for Use in Critically Ill Adults: A Psychometric Analysis and Systematic Review

Céline Gélinas,Mélanie Bérubé,Annie Chevrier,Brenda T Pun,E Wesley Ely,Yoanna Skrobik,Juliana Barr,Brenda T. Pun,E. Wesley Ely

DOI: https://doi.org/10.4037/ccn2018633

2018-02-01

Critical Care Nurse

Abstract:BACKGROUND Delirium is highly prevalent in critically ill patients. Its detection with valid tools is crucial. OBJECTIVE To analyze the development and psychometric properties of delirium assessment tools for critically ill adults. METHODS Databases were searched to identify relevant studies. Inclusion criteria were English language, publication before January 2015, 30 or more patients, and patient population of critically ill adults (>18 years old). Search terms were delirium, scales, critically ill patients, adult, validity, and reliability. Thirty-six manuscripts were identified, encompassing 5 delirium assessment tools (Confusion Assessment Method for the Intensive Care Unit (CAM-ICU), Cognitive Test for Delirium, Delirium Detection Score, Intensive Care Delirium Screening Checklist (ICDSC), and Nursing Delirium Screening Scale). Two independent reviewers analyzed the psychometric properties of these tools by using a standardized scoring system (range, 0–20) to assess the tool development process, reliability, validity, feasibility, and implementation of each tool. RESULTS Psychometric properties were very good for the CAM-ICU (19.6) and the ICDSC (19.2), moderate for the Nursing Delirium Screening Scale (13.6), low for the Delirium Detection Score (11.2), and very low for the Cognitive Test for Delirium (8.2). CONCLUSIONS The results indicate that the CAM-ICU and the ICDSC are the most valid and reliable delirium assessment tools for critically ill adults. Additional studies are needed to further validate these tools in critically ill patients with neurological disorders and those at various levels of sedation or consciousness.

nursing,critical care medicine
Predicting hospital mortality and length of stay: A prospective cohort study comparing the Intensive Care Delirium Screening Checklist versus Confusion Assessment Method for the Intensive Care Unit

Hsiu-Ching Li,Cheryl Chia-Hui Chen,Tony Yu-Chang Yeh,Shih-Cheng Liao,Adrian-Shengchun Hsu,Yu-Chung Wei,Shiow-Ching Shun,Shih-Chi Ku,Sharon K Inouye,Sharon K. Inouye

DOI: https://doi.org/10.1016/j.aucc.2022.01.010

IF: 3.265

2022-03-01

Australian Critical Care

Abstract:ObjectiveThe objective of this study was to compare two tools, the Intensive Care Delirium Screening Checklist (ICDSC) and Confusion Assessment Method for the intensive care unit (ICU) (CAM-ICU), for their predictive validity for outcomes related to delirium, hospital mortality, and length of stay (LOS).MethodsThe prospective study conducted in six medical ICUs at a tertiary care hospital in Taiwan enrolled consecutive patients (≥20 years) without delirium at ICU admission. Delirium was screened daily using the ICDSC and CAM-ICU in random order. Arousal was assessed by the Richmond Agitation–Sedation Scale (RASS). Participants with any one positive result were classified as ICDSC- or CAM-ICU-delirium groups.ResultsDelirium incidence evaluated by the ICDSC and CAM-ICU were 69.1% (67/97) and 50.5% (49/97), respectively. Although the ICDSC identified 18 more cases as delirious, substantial concordance (κ = 0.63; p < 0.001) was found between tools. Independent of age, Acute Physiology and Chronic Health Evaluation II score, and Charlson Comorbidity Index, both ICDSC- and CAM-ICU-rated delirium significantly predicted hospital mortality (adjusted odds ratio: 4.93; 95% confidence interval [CI]:1.56 to 15.63 vs. 2.79; 95% CI: 1.12 to 6.97, respectively), and only the ICDSC significantly predicted hospital LOS with a mean of 17.59 additional days compared with the no-delirium group. Irrespective of delirium status, a sensitivity analysis of normal-to-increased arousal (RASS≥0) test results did not alter the predictive ability of ICDSC- or CAM-ICU-delirium for hospital mortality (adjusted odds ratio: 2.97; 95% CI: 1.06 to 8.37 vs. 3.82; 95% CI: 1.35 to 10.82, respectively). With reduced arousal (RASS<0), neither tool significantly predicted mortality or LOS.ConclusionsThe ICDSC identified more delirium cases and may have higher predictive validity for mortality and LOS than the CAM-ICU. However, arousal substantially affected performance. Future studies may want to consider patients' arousal when deciding which tool to use to maximise the effects of delirium identification on patient mortality.

nursing,critical care medicine
Development and validation of delirium prediction models for noncardiac surgery patients

Julian Rössler,Karan Shah,Sara Medellin,Alparslan Turan,Kurt Ruetzler,Mriganka Singh,Daniel I Sessler,Kamal Maheshwari,Daniel I. Sessler

DOI: https://doi.org/10.1016/j.jclinane.2023.111319

IF: 9.375

2024-05-01

Journal of Clinical Anesthesia

Abstract:STUDY OBJECTIVE: Postoperative delirium is associated with morbidity and mortality, and its incidence varies widely. Using known predisposing and precipitating factors, we sought to develop postoperative delirium prediction models for noncardiac surgical patients.DESIGN: Retrospective prediction model study.SETTING: Major quaternary medical center.PATIENTS: Our January 2016 to June 2020 training dataset included 51,677 patients of whom 2795 patients had delirium. Our July 2020 to January 2022 validation dataset included 14,438 patients of whom 912 patients had delirium.INTERVENTIONS: None.MEASUREMENTS: We trained and validated two static prediction models and one dynamic delirium prediction model. For the static models, we used random survival forests and traditional Cox proportional hazard models to predict postoperative delirium from preoperative variables, or from a combination of preoperative and intraoperative variables. We also used landmark modeling to dynamically predict postoperative delirium using preoperative, intraoperative, and postoperative variables before onset of delirium.MAIN RESULTS: In the validation analyses, the static random forest model had a c-statistic of 0.81 (95% CI: 0.79, 0.82) and a Brier score of 0.04 with preoperative variables only, and a c-statistic of 0.86 (95% CI: 0.84, 0.87) and a Brier score of 0.04 when preoperative and intraoperative variables were combined. The corresponding Cox models had similar discrimination metrics with slightly better calibration. The dynamic model - using all available data, i.e., preoperative, intraoperative and postoperative data - had an overall c-index of 0.84 (95% CI: 0.83, 0.85).CONCLUSIONS: Using preoperative and intraoperative variables, simple static models performed as well as a dynamic delirium prediction model that also included postoperative variables. Baseline predisposing factors thus appear to contribute far more to delirium after noncardiac surgery than intraoperative or postoperative variables. Improved postoperative data capture may help improve delirium prediction and should be evaluated in future studies.

anesthesiology
An exploration of the reliability and usability of two delirium screening tools in an Australian intensive care unit: A pilot study

Rebecca Ewers,Melissa J Bloomer,Anastasia Hutchinson

DOI: https://doi.org/10.1016/j.iccn.2020.102919

Abstract:Objective: To compare the inter-rater reliability and usability of two delirium screening tools designed for use in ICU; the Confusion Assessment Method for ICU and the Intensive Care Delirium Screening Checklist. Research methodology/design: A multiple methods design was used. The intra and inter rater reliability of the tools were evaluated using Kappa statistics and intra class correlation coefficients. Focus groups were conducted to explore ICU staff perceptions of the usability of the tools and feasibility of delirium screening. Setting: Private hospital ICU, Melbourne Australia. Results: 66 patients were assessed for delirium; median age of 71 (IQR 62-75) years. Seventeen patients (26%) scored positive for delirium using the screening tools and 11 (17%) had delirium confirmed on the medical ICU discharge summary. Ten nurse assessors performed 99 paired assessments using the two tools sequentially, demonstrating the intra and inter-rater agreement and reliability of the tools was moderate to high. Four focus groups were conducted with 16 participants. Content analysis identified three themes: (i) current recognition of delirium, (ii) benefits of delirium screening, and (iii) future directions for delirium management. Time and medical staff indifference were identified as barriers to screening, facilitators were education and having a follow-up plan. Conclusion: This study found that the reliability and usability of the CAM-ICU and ICDSC were acceptable and that using structured delirium screening was feasible as part of a wider, multi-disciplinary delirium management plan.

Predicting delirium in older non-intensive care unit inpatients: development and validation of the DELIrium risK Tool (DELIKT)

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Development and validation of a delirium risk assessment tool in older patients admitted to the Emergency Department Observation Unit

Delirium prediction in the ICU: designing a screening tool for preventive interventions

Evaluation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for the patients in the intensive care unit

Machine learning-based delirium prediction in surgical in-patients: a prospective validation study

Clinical Prediction Models for Hospital-Induced Delirium Using Structured and Unstructured Electronic Health Record Data: Protocol for a Development and Validation Study

Development and validation of risk-stratification delirium prediction model for critically ill patients

Using Machine Learning and Electronic Health Records to Identify Neuropsychiatric Risk Scores for Delirium in ICU and General Hospital Settings

Occurrence and predictors of delirium in critically ill older patients: a prospective cohort study

Adaptation and Validation of a Chart-Based Delirium Detection Tool for the ICU (CHART-DEL-ICU)

A Predictive Model for Delirium in Hospitalized Elderly Medical Patients Based on Admission Characteristics

Validation of two nurse-based screening tools for delirium in elderly patients in general medical wards

Nomogram Models for Predicting Delirium of Patients in Emergency Intensive Care Unit: A Retrospective Cohort Study

Development and validation of an international preoperative risk assessment model for postoperative delirium

Development and Validation of an Electronic Health Record–Based Machine Learning Model to Estimate Delirium Risk in Newly Hospitalized Patients Without Known Cognitive Impairment

Delirium Assessment Tools for Use in Critically Ill Adults: A Psychometric Analysis and Systematic Review

Predicting hospital mortality and length of stay: A prospective cohort study comparing the Intensive Care Delirium Screening Checklist versus Confusion Assessment Method for the Intensive Care Unit

Development and validation of delirium prediction models for noncardiac surgery patients

An exploration of the reliability and usability of two delirium screening tools in an Australian intensive care unit: A pilot study