Machine learning-based prediction model for postoperative delirium in non-cardiac surgery

Dong Yun Lee,Ah Ran Oh,Jungchan Park,Seung-Hwa Lee,Byungjin Choi,Kwangmo Yang,Ha Yeon Kim,Rae Woong Park

DOI: https://doi.org/10.1186/s12888-023-04768-y

IF: 4.144

2023-05-05

BMC Psychiatry

Abstract:Postoperative delirium is a common complication that is distressing. This study aimed to demonstrate a prediction model for delirium.

psychiatry

What problem does this paper attempt to address?

Research progress in the Delirium Risk Prediction Models of post-operative patients in ICU

陈香萍,庄一渝,乔丽杰,劳月文,张奕,吴菲霞

DOI: https://doi.org/10.3760/cma.j.cn211501-20191227-03846

2020-01-01

Abstract:Regular assessment is a key to early detect and treat delirium. However, studies showed poor compliance and accuracy of delirium assessment by nurses. Moreover, delirium was characterized by acute onset and fluctuation of cognition. Therefore, delirium was frequently unrecognized. Postoperative delirium incidence in the intensive care unit was high and associated with poor outcome. Studies demonstrate delirium was preventable. Delirium prediction models were warranted to identify high-risk critically ill patients in order to apply preventive strategies. This article was to provide an overview of postoperative delirium and review postoperative delirium prediction models for surgical patients in the intensive care unit, thereby providing reference for development, validation as well as application of models in China.
A machine-learning model to predict postoperative delirium following knee arthroplasty using electronic health records

Jong Wook Jung,Sunghyun Hwang,Sunho Ko,Changwung Jo,Hye Youn Park,Hyuk-Soo Han,Myung Chul Lee,Jee Eun Park,Du Hyun Ro

DOI: https://doi.org/10.1186/s12888-022-04067-y

IF: 4.144

2022-06-29

BMC Psychiatry

Abstract:Postoperative delirium is a challenging complication due to its adverse outcome such as long hospital stay. The aims of this study were: 1) to identify preoperative risk factors of postoperative delirium following knee arthroplasty, and 2) to develop a machine-learning prediction model.

psychiatry
Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Xiangping Chen,Yuewen Lao,Yi Zhang,Lijie Qiao,Yiyu Zhuang

DOI: https://doi.org/10.21037/apm-20-1183

2020-01-01

Annals of Palliative Medicine

Abstract:BACKGROUND:An emerging approach to prevent delirium in an intensive care unit is the use of risk prediction models. At present, there is no scientific comparison of the predictive effect of the prediction model. This systematic review and meta-analysis aimed to compare the performance of available delirium risk prediction models for intensive care units.METHODS:As of June 1st, 2019, articles on delirium prediction models of the intensive care patients were searched in the Cochrane Library, PubMed, Embase, Web of Science, CINAHL, ProQuest, and four Chinese databases. Studies describing the development or validation of risk prediction models for predicting delirium in ICU patients were included. The Prediction model Risk of Bias Assessment Tool (PROBAST) was used to assess the quality of included studies. A meta-analysis of the predictive performance was performed using the forest plot package in R3.6.1.RESULTS:A total of 21 studies with 14 models were included in this article. PRE-DELIRIC, E-PREDELIRIC, and recalibrated PRE-DELIRIC model were the most popular models, which had been externally validated in at least two studies. The pooled area under the receiver operator characteristic curve (AUC) were 0.844 (95% CI: 0.793-0.896), 0.763 (95% CI: 0.680-0.846) and 0.776 (95% CI: 0.738-0.813) respectively. Most of the other models were with C-statistics above 0.7.CONCLUSIONS:The E-PRE-DELIRIC model, PRE-DELIRIC model, or both are recommended to predict ICU delirium risk. However, the recommendation should be considered with caution because of substantial heterogeneity. The protocol was registered with PROSPERO (CRD42019130802).
Machine learning with clinical and intraoperative biosignal data for predicting postoperative delirium after cardiac surgery

Changho Han,Hyun Il Kim,Sarah Soh,Ja Woo Choi,Jong Wook Song,Dukyong Yoon

DOI: https://doi.org/10.1016/j.isci.2024.109932

IF: 5.8

2024-05-08

iScience

Abstract:Early identification of patients at high risk of delirium is crucial for its prevention. Our study aimed to develop machine learning models to predict delirium after cardiac surgery using intraoperative biosignals and clinical data. We introduced a novel approach to extract relevant features from continuously measured intraoperative biosignals. These features reflect the patient's overall or baseline status, the extent of unfavorable conditions encountered intraoperatively, and beat-to-beat variability within the data. We developed a soft voting ensemble machine learning model using retrospective data from 1,912 patients. The model was then prospectively validated with data from 202 additional patients, achieving a high performance with an area under the receiver operating characteristic curve of 0.887 and an accuracy of 0.881. According to the SHapley Additive exPlanation method, several intraoperative biosignal features had high feature importance, suggesting that intraoperative patient management plays a crucial role in preventing delirium after cardiac surgery.
A machine learning-based prediction model for postoperative delirium in cardiac valve surgery using electronic health records

Qiuying Li,Jiaxin Li,Jiansong Chen,Xu Zhao,Jian Zhuang,Guoping Zhong,Yamin Song,Liming Lei

DOI: https://doi.org/10.1186/s12872-024-03723-3

IF: 2.174

2024-01-19

BMC Cardiovascular Disorders

Abstract:Previous models for predicting delirium after cardiac surgery remained inadequate. This study aimed to develop and validate a machine learning-based prediction model for postoperative delirium (POD) in cardiac valve surgery patients.

cardiac & cardiovascular systems
Postoperative delirium prediction after cardiac surgery using machine learning models

Tan Yang,Hai Yang,Yan Liu,Xiao Liu,Yi-Jie Ding,Run Li,An-Qiong Mao,Yue Huang,Xiao-Liang Li,Ying Zhang,Feng-Xu Yu

DOI: https://doi.org/10.1016/j.compbiomed.2023.107818

IF: 7.7

2023-12-22

Computers in Biology and Medicine

Abstract:Objective Postoperative delirium (POD) is a common postoperative complication in elderly patients, especially those undergoing cardiac surgery, which seriously affects the short- and long-term prognosis of patients. Early identification of risk factors for the development of POD can help improve the perioperative management of surgical patients. In the present study, five machine learning models were developed to predict patients at high risk of delirium after cardiac surgery and their performance was compared. Methods A total of 367 patients who underwent cardiac surgery were retrospectively included in this study. Using single-factor analysis, 21 risk factors for POD were selected for inclusion in machine learning. The dataset was divided using 10-fold cross-validation for model training and testing. Five machine learning models (random forest (RF), support vector machine (SVM), radial based kernel neural network (RBFNN), K-nearest neighbour (KNN), and Kernel ridge regression (KRR)) were compared using area under the receiver operating characteristic curve (AUC‐ROC), accuracy (ACC), sensitivity (SN), specificity (SPE), and Matthews coefficient (MCC). Results Among 367 patients, 105 patients developed POD, the incidence of delirium was 28.6 %. Among the five ML models, RF had the best performance in ACC (87.99 %), SN (69.27 %), SPE (95.38 %), MCC (70.00 %) and AUC (0.9202), which was far superior to the other four models. Conclusion Delirium is common in patients after cardiac surgery. This analysis confirms the importance of the computational ML models in predicting the occurrence of delirium after cardiac surgery, especially the outstanding performance of the RF model, which has practical clinical applications for early identification of patients at risk of developing POD.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Development and Validation of Machine Learning Models to Predict Postoperative Delirium Using Clinical Features and Polysomnography Variables

Woo-Seok Ha,Bo-Kyu Choi,Jungyeon Yeom,Seungwon Song,Soomi Cho,Min-Kyung Chu,Won-Joo Kim,Kyoung Heo,Kyung-Min Kim

DOI: https://doi.org/10.3390/jcm13185485

2024-09-16

Abstract:Background: Delirium affects up to 50% of patients following high-risk surgeries and is associated with poor long-term prognosis. This study employed machine learning to predict delirium using polysomnography (PSG) and sleep-disorder questionnaire data, and aimed to identify key sleep-related factors for improved interventions and patient outcomes. Methods: We studied 912 adults who underwent surgery under general anesthesia at a tertiary hospital (2013-2024) and had PSG within 5 years of surgery. Delirium was assessed via clinical diagnoses, antipsychotic prescriptions, and psychiatric consultations within 14 days postoperatively. Sleep-related data were collected using PSG and questionnaires. Machine learning predictions were performed to identify postoperative delirium, focusing on model accuracy and feature importance. Results: This study divided the 912 patients into an internal training set (700) and an external test set (212). Univariate analysis identified significant delirium risk factors: midazolam use, prolonged surgery duration, and hypoalbuminemia. Sleep-related variables such as fewer rapid eye movement (REM) episodes and higher daytime sleepiness were also linked to delirium. An extreme gradient-boosting-based classification task achieved an AUC of 0.81 with clinical variables, 0.60 with PSG data alone, and 0.84 with both, demonstrating the added value of PSG data. Analysis of Shapley additive explanations values highlighted important predictors: surgery duration, age, midazolam use, PSG-derived oxygen saturation nadir, periodic limb movement index, and REM episodes, demonstrating the relationship between sleep patterns and the risk of delirium. Conclusions: The artificial intelligence model integrates clinical and sleep variables and reliably identifies postoperative delirium, demonstrating that sleep-related factors contribute to its identification. Predicting patients at high risk of developing postoperative delirium and closely monitoring them could reduce the costs and complications associated with delirium.
Machine Learning Models of Postoperative Atrial Fibrillation Prediction After Cardiac Surgery.

Yufan Lu,Qingjuan Chen,Hu Zhang,Meijiao Huang,Yu Yao,Yue Ming,Min Yan,Yunxian Yu,Lina Yu

DOI: https://doi.org/10.1053/j.jvca.2022.11.025

IF: 2.894

2022-01-01

Journal of Cardiothoracic and Vascular Anesthesia

Abstract:OBJECTIVES:This study aimed to use machine learning algorithms to build an efficient forecasting model of atrial fibrillation after cardiac surgery, and to compare the predictive performance of machine learning to traditional logistic regression. DESIGN:A retrospective study. SETTING:Second Affiliated Hospital of Zhejiang University School of Medicine. PARTICIPANTS:The study comprised 1,400 patients who underwent valve and/or coronary artery bypass grafting surgery with cardiopulmonary bypass from September 1, 2013 to December 31, 2018. INTERVENTIONS:None. MEASUREMENTS AND MAIN RESULTS:Two machine learning approaches (gradient-boosting decision tree and support-vector machine) and logistic regression were used to build predictive models. The performance was compared by the area under the curve (AUC). The clinical practicability was assessed using decision curve analysis. Postoperative atrial fibrillation occurred in 519 patients (37.1%). The AUCs of the support-vector machine, logistic regression, and gradient boosting decision tree were 0.777 (95% CI: 0.772-0.781), 0.767 (95% CI: 0.762-0.772), and 0.765 (95% CI: 0.761-0.770), respectively. As decision curve analysis manifested, these models had achieved appropriate net benefit. CONCLUSION:In the authors' study, the support-vector machine model was the best predictor; it may be an effective tool for predicting atrial fibrillation after cardiac surgery.
Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Wen Gao,Yuping Zhang,Jingfen Jin

DOI: https://doi.org/10.1111/nicc.12674

2022-01-01

Nursing in Critical Care

Abstract:Background The early prediction model for delirium in intensive care units (ICUs)-E-PRE-DELIRIC-has been created to predict delirium development during the length of stay in ICUs. However, there have been few early predictive models for delirium in the cardiac surgical ICU (CSICU), and the predictive ability of the E-PRE-DELIRIC among patients following cardiac surgeries is still unknown. Aims and objectives To validate the performance of E-PRE-DELIRIC in CSICU. Design A retrospective cohort study. Methods Data were retrospectively extracted from the electronic records for patients admitted in CSICU from January 2018 to December 2018 in a tertiary teaching hospital in China. Adult patients were included following the criteria of the E-PRE-DELIRIC model. Predictors, including age, history of cognitive impairment, history of alcohol abuse, urgent admission, use of corticosteroids, respiratory failure, blood urea nitrogen, and mean arterial pressure, at the time of ICU admission were retrieved, and delirium was assessed twice a day using the Confusion Assessment Method for the ICU. The performance of the E-PRE-DELIRIC model was evaluated by area under receiver operator characteristic curve, precision-recall curve (AUPRC), Hosmer-Lemeshow (HL) test, and calibration belt. Results Of the 725 patients included, 120 (16.6%) developed delirium. The AUROC was 0.54 (95% confidence interval [CI], 0.48-0.59), and the AUPRC was 0.18 (95% CI, 0.12-0.20). The HL test showed a significant difference between predicted probability and delirium occurrence (chi(2) = 17.326, P = .027), and the overestimation chance of the E-PRE-DELIRIC score was 0.24 to 0.43. Conclusion The E-PRE-DELIRIC model has poor-to-fair predictive value in this study; thus, its application among the CSICU patients is limited. Development of reliable and validated tools for early prediction of delirium in CSICU is required. Relevance to clinical practice Early prediction of delirium risk at CSICU admission is of vital importance and could provide timely information to caregivers. However, the E-PRE-DELIRIC model should be applied cautiously in the CSICU because of the significant probability of over-estimating the risk of developing delirium.
Postoperative delirium prediction using machine learning models and preoperative electronic health record data

Andrew Bishara,Catherine Chiu,Elizabeth L. Whitlock,Vanja C. Douglas,Sei Lee,Atul J. Butte,Jacqueline M. Leung,Anne L. Donovan

DOI: https://doi.org/10.1186/s12871-021-01543-y

IF: 2.376

2022-01-03

BMC Anesthesiology

Abstract:Abstract Background Accurate, pragmatic risk stratification for postoperative delirium (POD) is necessary to target preventative resources toward high-risk patients. Machine learning (ML) offers a novel approach to leveraging electronic health record (EHR) data for POD prediction. We sought to develop and internally validate a ML-derived POD risk prediction model using preoperative risk features, and to compare its performance to models developed with traditional logistic regression. Methods This was a retrospective analysis of preoperative EHR data from 24,885 adults undergoing a procedure requiring anesthesia care, recovering in the main post-anesthesia care unit, and staying in the hospital at least overnight between December 2016 and December 2019 at either of two hospitals in a tertiary care health system. One hundred fifteen preoperative risk features including demographics, comorbidities, nursing assessments, surgery type, and other preoperative EHR data were used to predict postoperative delirium (POD), defined as any instance of Nursing Delirium Screening Scale ≥2 or positive Confusion Assessment Method for the Intensive Care Unit within the first 7 postoperative days. Two ML models (Neural Network and XGBoost), two traditional logistic regression models (“clinician-guided” and “ML hybrid”), and a previously described delirium risk stratification tool (AWOL-S) were evaluated using the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, positive likelihood ratio, and positive predictive value. Model calibration was assessed with a calibration curve. Patients with no POD assessments charted or at least 20% of input variables missing were excluded. Results POD incidence was 5.3%. The AUC-ROC for Neural Net was 0.841 [95% CI 0. 816–0.863] and for XGBoost was 0.851 [95% CI 0.827–0.874], which was significantly better than the clinician-guided (AUC-ROC 0.763 [0.734–0.793], p < 0.001) and ML hybrid (AUC-ROC 0.824 [0.800–0.849], p < 0.001) regression models and AWOL-S (AUC-ROC 0.762 [95% CI 0.713–0.812], p < 0.001). Neural Net, XGBoost, and ML hybrid models demonstrated excellent calibration, while calibration of the clinician-guided and AWOL-S models was moderate; they tended to overestimate delirium risk in those already at highest risk. Conclusion Using pragmatically collected EHR data, two ML models predicted POD in a broad perioperative population with high discrimination. Optimal application of the models would provide automated, real-time delirium risk stratification to improve perioperative management of surgical patients at risk for POD.

anesthesiology
Development of postoperative delirium prediction models in patients undergoing cardiovascular surgery using machine learning algorithms

Chie Nagata,Masahiro Hata,Yuki Miyazaki,Hirotada Masuda,Tamiki Wada,Tasuku Kimura,Makoto Fujii,Yasushi Sakurai,Yasuko Matsubara,Kiyoshi Yoshida,Shigeru Miyagawa,Manabu Ikeda,Takayoshi Ueno

DOI: https://doi.org/10.1038/s41598-023-48418-5

2023-11-30

Abstract:Associations between delirium and postoperative adverse events in cardiovascular surgery have been reported and the preoperative identification of high-risk patients of delirium is needed to implement focused interventions. We aimed to develop and validate machine learning models to predict post-cardiovascular surgery delirium. Patients aged ≥ 40 years who underwent cardiovascular surgery at a single hospital were prospectively enrolled. Preoperative and intraoperative factors were assessed. Each patient was evaluated for postoperative delirium 7 days after surgery. We developed machine learning models using the Bernoulli naive Bayes, Support vector machine, Random forest, Extra-trees, and XGBoost algorithms. Stratified fivefold cross-validation was performed for each developed model. Of the 87 patients, 24 (27.6%) developed postoperative delirium. Age, use of psychotropic drugs, cognitive function (Mini-Cog < 4), index of activities of daily living (Barthel Index < 100), history of stroke or cerebral hemorrhage, and eGFR (estimated glomerular filtration rate) < 60 were selected to develop delirium prediction models. The Extra-trees model had the best area under the receiver operating characteristic curve (0.76 [standard deviation 0.11]; sensitivity: 0.63; specificity: 0.78). XGBoost showed the highest sensitivity (AUROC, 0.75 [0.07]; sensitivity: 0.67; specificity: 0.79). Machine learning algorithms could predict post-cardiovascular delirium using preoperative data.Trial registration: UMIN-CTR (ID; UMIN000049390).
Predicting delirium and the effects of medications in hospitalized COVID-19 patients using machine learning: A retrospective study within the Korean Multidisciplinary Cohort for Delirium Prevention (KoMCoDe)

So Hee Lee,Hyun Jung Hur,Sung Nyun Kim,Jang Ho Ahn,Du Hyun Ro,Arum Hong,Hye Yoon Park,Pyoeng Gyun Choe,Back Kim,Hye Youn Park

DOI: https://doi.org/10.1177/20552076231223811

2024-01-01

Digital Health

Abstract:Objective Delirium is commonly reported from the inpatients with Coronavirus disease 2019 (COVID-19) infection. As delirium is closely associated with adverse clinical outcomes, prediction and prevention of delirium is critical. We developed a machine learning (ML) model to predict delirium in hospitalized patients with COVID-19 and to identify modifiable factors to prevent delirium. Methods The data set (n = 878) from four medical centers was constructed. Total of 78 predictors were included such as demographic characteristics, vital signs, laboratory results and medication, and the primary outcome was delirium occurrence during hospitalization. For analysis, the extreme gradient boosting (XGBoost) algorithm was applied, and the most influential factors were selected by recursive feature elimination. Among the indicators of performance for ML model, the area under the curve of the receiver operating characteristic (AUROC) curve was selected as the evaluation metric. Results Regarding the performance of developed delirium prediction model, the accuracy, precision, recall, F1 score, and the AUROC were calculated (0.944, 0.581, 0.421, 0.485, 0.873, respectively). The influential factors of delirium in this model included were mechanical ventilation, medication (antipsychotics, sedatives, ambroxol, piperacillin/tazobactam, acetaminophen, ceftriaxone, and propacetamol), and sodium ion concentration (all p < 0.05). Conclusions We developed and internally validated an ML model to predict delirium in COVID-19 inpatients. The model identified modifiable factors associated with the development of delirium and could be clinically useful for the prediction and prevention of delirium in COVID-19 inpatients.

public, environmental & occupational health,health care sciences & services,medical informatics,health policy & services
Machine Learning Algorithm Using Electronic Chart-Derived Data to Predict Delirium After Elderly Hip Fracture Surgeries: A Retrospective Case-Control Study

Hong Zhao,Jiaming You,Yuexing Peng,Yi Feng

DOI: https://doi.org/10.3389/fsurg.2021.634629

IF: 1.8

2021-07-13

Frontiers in Surgery

Abstract:Background: Elderly patients undergoing hip fracture repair surgery are at increased risk of delirium due to aging, comorbidities, and frailty. But current methods for identifying the high risk of delirium among hospitalized patients have moderate accuracy and require extra questionnaires. Artificial intelligence makes it possible to establish machine learning models that predict incident delirium risk based on electronic health data. Methods: We conducted a retrospective case-control study on elderly patients (≥65 years of age) who received orthopedic repair with hip fracture under spinal or general anesthesia between June 1, 2018, and May 31, 2019. Anesthesia records and medical charts were reviewed to collect demographic, surgical, anesthetic features, and frailty index to explore potential risk factors for postoperative delirium. Delirium was assessed by trained nurses using the Confusion Assessment Method (CAM) every 12 h during the hospital stay. Four machine learning risk models were constructed to predict the incidence of postoperative delirium: random forest, eXtreme Gradient Boosting (XGBoosting), support vector machine (SVM), and multilayer perception (MLP). K-fold cross-validation was deployed to accomplish internal validation and performance evaluation. Results: About 245 patients were included and postoperative delirium affected 12.2% (30/245) of the patients. Multiple logistic regression revealed that dementia/history of stroke [OR 3.063, 95% CI (1.231, 7.624)], blood transfusion [OR 2.631, 95% CI (1.055, 6.559)], and preparation time [OR 1.476, 95% CI (1.170, 1.862)] were associated with postoperative delirium, achieving an area under receiver operating curve (AUC) of 0.779, 95% CI (0.703, 0.856). The accuracy of machine learning models for predicting the occurrence of postoperative delirium ranged from 83.67 to 87.75%. Machine learning methods detected 16 risk factors contributing to the development of delirium. Preparation time, frailty index uses of vasopressors during the surgery, dementia/history of stroke, duration of surgery, and anesthesia were the six most important risk factors of delirium. Conclusion: Electronic chart-derived machine learning models could generate hospital-specific delirium prediction models and calculate the contribution of risk factors to the occurrence of delirium. Further research is needed to evaluate the significance and applicability of electronic chart-derived machine learning models for the detection risk of delirium in elderly patients undergoing hip fracture repair surgeries.

surgery
Development and validation of a machine learning model to predict postoperative delirium using a nationwide database: A retrospective, observational study

Manabu Yoshimura,Hiroko Shiramoto,Mami Koga,Yasuhiro Morimoto

DOI: https://doi.org/10.1016/j.jclinane.2024.111491

IF: 9.375

2024-04-29

Journal of Clinical Anesthesia

Abstract:Study objective Postoperative delirium is a neuropsychological syndrome that typically occurs in surgical patients. Its onset can lead to prolonged hospitalization as well as increased morbidity and mortality. Therefore, it is important to promptly identify its signs. This study aimed to develop and validate a machine learning predictive model for postoperative delirium using extensive population data. Design Retrospective observational study. Setting Japanese Diagnosis Procedure Combination inpatient data. Data were used for internal (2016.4–2018.12) and temporal validation (2019.01–2019.10). Patients Patients aged ≥65 years who underwent general anesthesia for surgical procedure. Measurements The primary outcome was postoperative delirium, which was defined as a condition requiring newly prescribed antipsychotic drugs or assignment of the corresponding insurance claim code after the date of surgery. We trained and tuned the optimal machine-learning model through 10-fold cross-validation using the selected optimal area under the receiver operating characteristic curve (AUC) value. In the temporal validation, we measured the performance of our model. Main results The analysis included 557,990 patients. The light-gradient boosting machine models showed a higher AUC value (0.826 [95% confidence interval (CI): 0.822–0.829]) than the other models. Regarding performance, the model had a recall value of 0.124 (95% CI: 0.119–0.129) and precision value of 0.659 (95% CI: 0.641–0.677]). This performance was sustained in the temporal validation (AUC, 0.815 [95% CI: 0.811–0.818]). At a sensitivity of 0.80, the model achieved a specificity of 0.672 (95% CI: 0.670–0.674]), a negative predictive value of 0.975 (95% CI: 0.974–0.975), and a positive predictive value of 0.176 (95% CI: 0.176–0.179). Conclusions Using extensive Diagnostic Procedure Combination data, we successfully created and validated a machine learning model for predicting postoperative delirium. This model may facilitate prediction of postoperative delirium.

anesthesiology
Two-stage prediction model for postoperative delirium in patients in the intensive care unit after cardiac surgery

Shining Cai,Hang Cui,Wenyan Pan,Jingjing Li,Xiaolei Lin,Yuxia Zhang

DOI: https://doi.org/10.1093/ejcts/ezac573

2022-01-01

Abstract:OBJECTIVES: Postoperative delirium is a common severe complication in patients in the intensive care unit after cardiac surgery. We developed a two-stage prediction model and quantified the risk of developing postoperative delirium to assist in early prevention before and after surgery. METHODS: We conducted a prospective cohort study and consecutively recruited adult patients after cardiac surgery. The Confusion Assessment Method for patients in the intensive care unit was used to diagnose delirium 5 days postoperatively. The stage I model was constructed using patient demographics, health conditions and laboratory results obtained preoperatively, whereas the stage II model was built on both pre-and postoperative predictors. The model was validated internally using the bootstrap method and externally using data from an external cohort. RESULTS: The two-stage model was developed with 654 patients and was externally validated with 214 patients undergoing cardiac surgery. The stage I model contained 6 predictors, whereas the stage II model included 10 predictors. The stage I model had an area under the receiver operating characteristic curve of 0.76 (95% confidence interval: 0.68-0.81), and the stage II model's area under the receiver operating characteristic curve increased to 0.85 [95% confidence interval (CI): 0.81-0.89]. The external validation resulted in an area under the curve of 0.76 (95% CI: 0.67-0.86) for the stage I model and 0.78 (95% CI: 0.69-0.86) for the stage II model. CONCLUSIONS: The two-stage model assisted medical staff in identifying patients at high risk for postoperative delirium before and 24 h after cardiac surgery. This model showed good discriminative power and predictive accuracy and can be easily accessed in clinical settings.
Machine Learning for Prediction of Postoperative Delirium in Adult Patients: A Systematic Review and Meta-analysis

Hao Chen,Dongdong Yu,Jing Zhang,Jianli Li

DOI: https://doi.org/10.1016/j.clinthera.2024.09.013

IF: 3.637

2024-10-14

Clinical Therapeutics

Abstract:Purpose This meta-analysis aimed to evaluate the performance of machine learning (ML) models in predicting postoperative delirium (POD) and to provide guidance for clinical application. Methods PubMed, Embase, Cochrane Library, and Web of Science databases were searched from inception to April 29, 2024. Studies reported ML models for predicting POD in adult patients were included. Data extraction and risk of bias assessment were performed using the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis - AI (TRIPOD-AI) and Prediction model Risk Of Bias ASsessment Tool (PROBAST) tools. Meta-analysis with the area under the curve (AUC) was performed using MedCalc software. Findings A total of 23 studies were included after screening. Age (n = 20, 86.95%) and Random Forest (RF) (n = 24, 17.27%) were the most frequently used feature and ML algorithm, respectively. The meta-analysis showed an overall AUC of 0.792. The ensemble models (AUC = 0.805) showed better predictive performance than single models (AUC = 0.782). Additionally, considerable variations in AUC were found among different ML algorithms, with AdaBoost (AB) demonstrating good performance with AUC of 0.870. Notably, the generalizability of these models was uncertain due to limitations in external validation and bias assessment. Implications The performance of ensemble models were higher than single models, and the AB algorithms demonstrated better performance, compared with other algorithms. However, further research was needed to enhance the generalizability and transparency of ML models.

pharmacology & pharmacy
Development and validation of delirium prediction models for noncardiac surgery patients

Julian Rössler,Karan Shah,Sara Medellin,Alparslan Turan,Kurt Ruetzler,Mriganka Singh,Daniel I Sessler,Kamal Maheshwari,Daniel I. Sessler

DOI: https://doi.org/10.1016/j.jclinane.2023.111319

IF: 9.375

2024-05-01

Journal of Clinical Anesthesia

Abstract:STUDY OBJECTIVE: Postoperative delirium is associated with morbidity and mortality, and its incidence varies widely. Using known predisposing and precipitating factors, we sought to develop postoperative delirium prediction models for noncardiac surgical patients.DESIGN: Retrospective prediction model study.SETTING: Major quaternary medical center.PATIENTS: Our January 2016 to June 2020 training dataset included 51,677 patients of whom 2795 patients had delirium. Our July 2020 to January 2022 validation dataset included 14,438 patients of whom 912 patients had delirium.INTERVENTIONS: None.MEASUREMENTS: We trained and validated two static prediction models and one dynamic delirium prediction model. For the static models, we used random survival forests and traditional Cox proportional hazard models to predict postoperative delirium from preoperative variables, or from a combination of preoperative and intraoperative variables. We also used landmark modeling to dynamically predict postoperative delirium using preoperative, intraoperative, and postoperative variables before onset of delirium.MAIN RESULTS: In the validation analyses, the static random forest model had a c-statistic of 0.81 (95% CI: 0.79, 0.82) and a Brier score of 0.04 with preoperative variables only, and a c-statistic of 0.86 (95% CI: 0.84, 0.87) and a Brier score of 0.04 when preoperative and intraoperative variables were combined. The corresponding Cox models had similar discrimination metrics with slightly better calibration. The dynamic model - using all available data, i.e., preoperative, intraoperative and postoperative data - had an overall c-index of 0.84 (95% CI: 0.83, 0.85).CONCLUSIONS: Using preoperative and intraoperative variables, simple static models performed as well as a dynamic delirium prediction model that also included postoperative variables. Baseline predisposing factors thus appear to contribute far more to delirium after noncardiac surgery than intraoperative or postoperative variables. Improved postoperative data capture may help improve delirium prediction and should be evaluated in future studies.

anesthesiology
Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Ryoung-Eun Ko,Jihye Lee,Sungeun Kim,Joong Hyun Ahn,Soo Jin Na,Jeong Hoon Yang

DOI: https://doi.org/10.1016/j.rec.2023.12.007

Abstract:Introduction and objectives: Delirium, recognized as a crucial prognostic factor in the cardiac intensive care unit (CICU), has evolved in response to the changing demographics among critically ill cardiac patients. This study aimed to create a predictive model for delirium for patients in the CICU. Methods: This study included consecutive patients admitted to the CICU of the Samsung Medical Center. To assess the candidate variables for the model: we applied the following machine learning methods: random forest, extreme gradient boosting, partial least squares, and Plmnet-elastic.net. After selecting relevant variables, we performed a logistic regression analysis to derive the model formula. Internal validation was conducted using 100-repeated hold-out validation. Results: We analyzed 2774 patients, 677 (24.4%) of whom developed delirium in the CICU. Machine learning-based models showed good predictive performance. Clinically significant and frequently important predictors were selected to construct a delirium prediction scoring model for CICU patients. The model included albumin level, international normalized ratio, blood urea nitrogen, white blood cell count, C-reactive protein level, age, heart rate, and mechanical ventilation. The model had an area under the receiver operating characteristics curve (AUROC) of 0.861 (95%CI, 0.843-0.879). Similar results were obtained in internal validation with 100-repeated cross-validation (AUROC, 0.854; 95%CI, 0.826-0.883). Conclusions: Using variables frequently ranked as highly important in four machine learning methods, we created a novel delirium prediction model. This model could serve as a useful and simple tool for risk stratification for the occurrence of delirium at the patient's bedside in the CICU.
Automated machine learning‐based model predicts postoperative delirium using readily extractable perioperative collected electronic data

Xiao‐Yi Hu,He Liu,Xue Zhao,Xun Sun,Jian Zhou,Xing Gao,Hui‐Lian Guan,Yang Zhou,Qiu Zhao,Yuan Han,Jun‐Li Cao

DOI: https://doi.org/10.1111/cns.13758

2021-11-18

Abstract:OBJECTIVE: Postoperative delirium (POD) is a common postoperative complication that is relevant to poor outcomes. Therefore, it is critical to find effective methods to identify patients with high risk of POD rapidly. Creating a fully automated score based on an automated machine-learning algorithm may be a method to predict the incidence of POD quickly.MATERIALS AND METHODS: This is the secondary analysis of an observational study, including 531 surgical patients who underwent general anesthesia. The least absolute shrinkage and selection operator (LASSO) was used to screen essential features associated with POD. Finally, eight features (age, intraoperative blood loss, anesthesia duration, extubation time, intensive care unit [ICU] admission, mini-mental state examination score [MMSE], Charlson comorbidity index [CCI], postoperative neutrophil-to-lymphocyte ratio [NLR]) were used to established models. Four models, logistic regression, random forest, extreme gradient boosted trees, and support vector machines, were built in a training set (70% of participants) and evaluated in the remaining testing sample (30% of participants). Multivariate logistic regression analysis was used to explore independent risk factors for POD further.RESULTS: Model 1 (logistic regression model) was found to outperform other classifier models in testing data (area under the curve [AUC] of 80.44%, 95% confidence interval [CI] 72.24%-88.64%) and achieve the lowest Brier Score as well. These variables including age (OR = 1.054, 95%CI: 1.017~1.093), extubation time (OR = 1.027, 95%CI: 1.012~1.044), ICU admission (OR = 2.238, 95%CI: 1.313~3.793), MMSE (OR = 0.929, 95%CI: 0.876~0.984), CCI (OR = 1.197, 95%CI: 1.038~1.384), and postoperative NLR (OR = 1.029, 95%CI: 1.002~1.057) were independent risk factors for POD in this study.CONCLUSIONS: We have built and validated a high-performing algorithm to demonstrate the extent to which patient risk changes of POD during the perioperative period, thus leading to a rational therapeutic choice.

pharmacology & pharmacy,neurosciences
Machine learning-based delirium prediction in surgical in-patients: a prospective validation study

Stefanie Jauk,Diether Kramer,Stefan Sumerauer,Sai Pavan Kumar Veeranki,Michael Schrempf,Paul Puchwein

DOI: https://doi.org/10.1093/jamiaopen/ooae091

2024-09-17

JAMIA Open

Abstract:Objective: Delirium is a syndrome that leads to severe complications in hospitalized patients, but is considered preventable in many cases. One of the biggest challenges is to identify patients at risk in a hectic clinical routine, as most screening tools cause additional workload. The aim of this study was to validate a machine learning (ML)-based delirium prediction tool on surgical in-patients undergoing a systematic assessment of delirium. Materials and methods: 738 in-patients of a vascular surgery, a trauma surgery and an orthopedic surgery department were screened for delirium using the DOS scale twice a day over their hospital stay. Concurrently, delirium risk was predicted by the ML algorithm in real-time for all patients at admission and evening of admission. The prediction was performed automatically based on existing EHR data and without any additional documentation needed. Results: 103 patients (14.0%) were screened positive for delirium using the DOS scale. Out of them, 85 (82.5%) were correctly identified by the ML algorithm. Specificity was slightly lower, detecting 463 (72.9%) out of 635 patients without delirium. The AUROC of the algorithm was 0.883 (95% CI, 0.8523-0.9147). Discussion: In this prospective validation study, the implemented machine-learning algorithm was able to detect patients with delirium in surgical departments with high discriminative performance. Conclusion: In future, this tool or similar decision support systems may help to replace time-intensive screening tools and enable efficient prevention of delirium.

Machine learning-based prediction model for postoperative delirium in non-cardiac surgery

Research progress in the Delirium Risk Prediction Models of post-operative patients in ICU

A machine-learning model to predict postoperative delirium following knee arthroplasty using electronic health records

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

Machine learning with clinical and intraoperative biosignal data for predicting postoperative delirium after cardiac surgery

A machine learning-based prediction model for postoperative delirium in cardiac valve surgery using electronic health records

Postoperative delirium prediction after cardiac surgery using machine learning models

Development and Validation of Machine Learning Models to Predict Postoperative Delirium Using Clinical Features and Polysomnography Variables

Machine Learning Models of Postoperative Atrial Fibrillation Prediction After Cardiac Surgery.

Validation of E-PRE-DELIRIC in cardiac surgical ICU delirium: A retrospective cohort study

Postoperative delirium prediction using machine learning models and preoperative electronic health record data

Development of postoperative delirium prediction models in patients undergoing cardiovascular surgery using machine learning algorithms

Predicting delirium and the effects of medications in hospitalized COVID-19 patients using machine learning: A retrospective study within the Korean Multidisciplinary Cohort for Delirium Prevention (KoMCoDe)

Machine Learning Algorithm Using Electronic Chart-Derived Data to Predict Delirium After Elderly Hip Fracture Surgeries: A Retrospective Case-Control Study

Development and validation of a machine learning model to predict postoperative delirium using a nationwide database: A retrospective, observational study

Two-stage prediction model for postoperative delirium in patients in the intensive care unit after cardiac surgery

Machine Learning for Prediction of Postoperative Delirium in Adult Patients: A Systematic Review and Meta-analysis

Development and validation of delirium prediction models for noncardiac surgery patients

Machine learning methods for developing a predictive model of the incidence of delirium in cardiac intensive care units

Automated machine learning‐based model predicts postoperative delirium using readily extractable perioperative collected electronic data

Machine learning-based delirium prediction in surgical in-patients: a prospective validation study