Abstract:Background: Extubation failure (EF) can lead to an increased chance of ventilator-associated pneumonia, longer hospital stays, and a higher mortality rate. This study aimed to develop and validate an accurate machine-learning model to predict EF in intensive care units (ICUs). Methods: Patients who underwent extubation in the Medical Information Mart for Intensive Care (MIMIC)-IV database were included. EF was defined as the need for ventilatory support (non-invasive ventilation or reintubation) or death within 48 h following extubation. A machine-learning model called Categorical Boosting (CatBoost) was developed based on 89 clinical and laboratory variables. SHapley Additive exPlanations (SHAP) values were calculated to evaluate feature importance and the recursive feature elimination (RFE) algorithm was used to select key features. Hyperparameter optimization was conducted using an automated machine-learning toolkit (Neural Network Intelligence). The final model was trained based on key features and compared with 10 other models. The model was then prospectively validated in patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. In addition, a web-based tool was developed to help clinicians use our model. Results: Of 16,189 patients included in the MIMIC-IV cohort, 2,756 (17.0%) had EF. Nineteen key features were selected using the RFE algorithm, including age, body mass index, stroke, heart rate, respiratory rate, mean arterial pressure, peripheral oxygen saturation, temperature, pH, central venous pressure, tidal volume, positive end-expiratory pressure, mean airway pressure, pressure support ventilation (PSV) level, mechanical ventilation (MV) durations, spontaneous breathing trial success times, urine output, crystalloid amount, and antibiotic types. After hyperparameter optimization, our model had the greatest area under the receiver operating characteristic (AUROC: 0.835) in internal validation. Significant differences in mortality, reintubation rates, and NIV rates were shown between patients with a high predicted risk and those with a low predicted risk. In the prospective validation, the superiority of our model was also observed (AUROC: 0.803). According to the SHAP values, MV duration and PSV level were the most important features for prediction. Conclusions: In conclusion, this study developed and prospectively validated a CatBoost model, which better predicted EF in ICUs than other models.

Development and internal validation of a predictive model for prolonged intensive care unit stays in patients with psychotropic drug poisoning

Risk Predictive Models for Delirium in the Intensive Care Unit: a Systematic Review and Meta-Analysis.

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Predictive model of risk factors for 28-day mortality in patients with sepsis or sepsis-associated delirium based on the MIMIC-IV database

A Multifactor Model for Predicting Mortality in Critically Ill Patients: A Multicenter Prospective Cohort Study

Construction of a risk prediction model for detecting postintensive care syndrome-mental disorders

Predicting Prolonged Length of ICU Stay Through Machine Learning.

Development and clinical empirical validation of the chronic critical illness prognosis prediction model

Development and Validation of a Clinical Prediction Model for Sleep Disorders in the ICU: A Retrospective Cohort Study

Development and validation of prediction models for neurocognitive disorders in adult patients admitted to the ICU with sleep disturbance

Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database

Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units

A machine-learning approach for dynamic prediction of sepsis-induced coagulopathy in critically ill patients with sepsis: an integrated analysis of the MIMIC-IV and eICU-CRD databases

Risk prediction models for post-intensive care syndrome of ICU discharged patients: a systematic review

Development and Validation of Machine Learning-Based Models for Prediction of Intensive Care Unit Admission and In-Hospital Mortality in Patients with Acute Exacerbations of Chronic Obstructive Pulmonary Disease

Development and validation of a postoperative delirium prediction model for patients admitted to an intensive care unit in China: a prospective study

Prediction Model of In-Hospital Death for Acute Exacerbation of Chronic Obstructive Pulmonary Disease Patients Admitted to Intensive Care Unit: The PD-ICU Score

Development of a machine learning-based prediction model for sepsis-associated delirium in the intensive care unit

Interpretable machine learning for predicting risk of invasive fungal infection in critically ill patients in the intensive care unit: A retrospective cohort study based on MIMIC-IV database

Development and validation of machine learning models to predict MDRO colonization or infection on ICU admission by using electronic health record data