On the planarity of iterated jump graphs

G. Chartrand,Donald W. VanderJagt,Ping Zhang

DOI: https://doi.org/10.1016/S0012-365X(00)00182-5

IF: 0.961

Discrete Mathematics

Abstract:

What problem does this paper attempt to address?

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Hao Ding,Xue Feng,Qi Yang,Yunmei Yang,Siyi Zhu,Xiaozhen Ji,Y. James Kang,Jichuan Shen,Ming Zhao,Shuchang Xu,Gangmin Ning,Yuheng Xu

DOI: https://doi.org/10.21203/rs.3.rs-3327850/v1

2023-01-01

Abstract:Abstract Background To analyze the risk factors associated with intubated critically ill patients in the emergency department (ED) and develop a prediction model by machine learning (ML) algorithms. Methods This study was conducted in an academic tertiary hospital in Hangzhou, China. Critical ill patients admitted to the ED were retrospectively analyzed from May 2018 to July 2022. The demographic characteristics, distribution of organ dysfunction, parameters for different organs’ examination, and status of mechanical ventilation were recorded. These patients were assigned to the positive and negative groups according to ventilation support. We used the eXtreme Gradient Boosting (XGBoost) algorithm to develop the prediction model and compared it with other algorithms, such as logistic regression (LR), artificial neural network (ANN), and random forest (RF). SHapley Additive exPlanations (SHAP) was used to analyze the risk factors of intubated critically ill patients in the ED. Then, the best performance of the predictive model was used for auxiliary diagnosis. Results Of 14,589 critically ill patients, 10212 comprised the training group and 4377 comprised the test group; 2289 intubated patients were obtained from the electronic medical records. The mean age, the mean scores of vital signs, the parameters of different organs, and blood oxygen examination results differed significantly between the two groups ( p < 0.05). The white blood cell count, international normalized ratio, respiratory rate, and pH are the top four risk factors for intubation in critically ill patients. Based on the risk factors in different predictive models, the XGBoost model showed the highest AUROC (0.8353) for predicting ED intubation. Conclusions For critically ill patients in the ED, the proposed model can predict potential intubation based on the risk factors in the clinically predictive model.
Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Jianyuan Liu,Xiangjie Duan,Minjie Duan,Yu Jiang,Wei Mao,Lilin Wang,Gang Liu

DOI: https://doi.org/10.1038/s41598-024-77798-5

IF: 4.6

2024-11-09

Scientific Reports

Abstract:Given the limited capacity to accurately determine the necessity for intubation in intensive care unit settings, this study aimed to develop and externally validate an interpretable machine learning model capable of predicting the need for intubation among ICU patients. Seven widely used machine learning (ML) algorithms were employed to construct the prediction models. Adult patients from the Medical Information Mart for Intensive Care IV database who stayed in the ICU for longer than 24 h were included in the development and internal validation. The model was subsequently externally validated using the eICU-CRD database. In addition, the SHapley Additive exPlanations method was employed to interpret the influence of individual parameters on the predictions made by the model. A total of 11,988 patients were included in the final cohort for this study. The CatBoost model demonstrated the best performance (AUC: 0.881). In the external validation set, the efficacy of our model was also confirmed (AUC: 0.750), which suggests robust generalization capabilities. The Glasgow Coma Scale (GCS), body mass index (BMI), arterial partial pressure of oxygen (PaO 2 ), respiratory rate (RR) and length of stay (LOS) before ICU were the top 5 features of the CatBoost model with the greatest impact. We developed an externally validated CatBoost model that accurately predicts the need for intubation in ICU patients within 24 to 96 h of admission, facilitating clinical decision-making and has the potential to improve patient outcomes. The prediction model utilizes readily obtainable monitoring parameters and integrates the SHAP method to enhance interpretability, providing clinicians with clear insights into the factors influencing predictions.

multidisciplinary sciences
Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units

Qin-Yu Zhao,Huan Wang,Jing-Chao Luo,Ming-Hao Luo,Le-Ping Liu,Shen-Ji Yu,Kai Liu,Yi-Jie Zhang,Peng Sun,Guo-Wei Tu,Zhe Luo

DOI: https://doi.org/10.3389/fmed.2021.676343

IF: 3.9

2021-05-17

Frontiers in Medicine

Abstract:Background: Extubation failure (EF) can lead to an increased chance of ventilator-associated pneumonia, longer hospital stays, and a higher mortality rate. This study aimed to develop and validate an accurate machine-learning model to predict EF in intensive care units (ICUs). Methods: Patients who underwent extubation in the Medical Information Mart for Intensive Care (MIMIC)-IV database were included. EF was defined as the need for ventilatory support (non-invasive ventilation or reintubation) or death within 48 h following extubation. A machine-learning model called Categorical Boosting (CatBoost) was developed based on 89 clinical and laboratory variables. SHapley Additive exPlanations (SHAP) values were calculated to evaluate feature importance and the recursive feature elimination (RFE) algorithm was used to select key features. Hyperparameter optimization was conducted using an automated machine-learning toolkit (Neural Network Intelligence). The final model was trained based on key features and compared with 10 other models. The model was then prospectively validated in patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. In addition, a web-based tool was developed to help clinicians use our model. Results: Of 16,189 patients included in the MIMIC-IV cohort, 2,756 (17.0%) had EF. Nineteen key features were selected using the RFE algorithm, including age, body mass index, stroke, heart rate, respiratory rate, mean arterial pressure, peripheral oxygen saturation, temperature, pH, central venous pressure, tidal volume, positive end-expiratory pressure, mean airway pressure, pressure support ventilation (PSV) level, mechanical ventilation (MV) durations, spontaneous breathing trial success times, urine output, crystalloid amount, and antibiotic types. After hyperparameter optimization, our model had the greatest area under the receiver operating characteristic (AUROC: 0.835) in internal validation. Significant differences in mortality, reintubation rates, and NIV rates were shown between patients with a high predicted risk and those with a low predicted risk. In the prospective validation, the superiority of our model was also observed (AUROC: 0.803). According to the SHAP values, MV duration and PSV level were the most important features for prediction. Conclusions: In conclusion, this study developed and prospectively validated a CatBoost model, which better predicted EF in ICUs than other models.

medicine, general & internal
A Risk Prediction Model for Efficient Intubation in the Emergency Department: A 4‐year Single‐center Retrospective Analysis

Hongbo Ding,Xue Feng,Qi Yang,Yichang Yang,Siyi Zhu,Xiaozhen Ji,Yangbo Kang,Jiashen Shen,Mei Zhao,Shanxiang Xu,Gangmin Ning,Yongan Xu

DOI: https://doi.org/10.1002/emp2.13190

2024-01-01

Journal of the American College of Emergency Physicians Open

Abstract:Objective: To analyze the risk factors associated with intubated critically ill patients in the emergency department (ED) and develop a prediction model by machine learning algorithms. Methods: This study was conducted in an academic tertiary hospital in Hangzhou, China. Critically ill patients admitted to the ED were retrospectively analyzed from May 2018 to July 2022. The demographic characteristics, distribution of organ dysfunction, parameters for different organs' examination, and status of mechanical ventilation were recorded. These patients were assigned to the intubation and non-intubation groups according to ventilation support. We used the eXtreme Gradient Boosting (XGBoost) algorithm to develop the prediction model and compared it with other algorithms, such as logistic regression, artificial neural network, and random forest. SHapley Additive exPlanations was used to analyze the risk factors of intubated critically ill patients in the ED. Results: Of 14,589 critically ill patients, 10,212 comprised the training group and 4377 comprised the test group; 2289 intubated patients were obtained from the electronic medical records. The mean age, mean scores of vital signs, parameters of different organs, and blood oxygen examination results differed significantly between the two groups (p < 0.05). The white blood cell count, international normalized ratio, respiratory rate, and pH are the top four risk factors for intubation in critically ill patients. Based on the risk factors in different predictive models, the XGBoost model showed the highest area under the receiver operating characteristic curve (0.84) for predicting ED intubation. Conclusions: For critically ill patients in the ED, the proposed model can predict potential intubation based on the risk factors in the clinically predictive model.
Early prediction of noninvasive ventilation failure after extubation: development and validation of a machine-learning model

Huan Wang,Qin-Yu Zhao,Jing-Chao Luo,Kai Liu,Shen-Ji Yu,Jie-Fei Ma,Ming-Hao Luo,Guang-Wei Hao,Ying Su,Yi-Jie Zhang,Guo-Wei Tu,Zhe Luo

DOI: https://doi.org/10.1186/s12890-022-02096-7

2022-08-08

Abstract:Background: Noninvasive ventilation (NIV) has been widely used in critically ill patients after extubation. However, NIV failure is associated with poor outcomes. This study aimed to determine early predictors of NIV failure and to construct an accurate machine-learning model to identify patients at risks of NIV failure after extubation in intensive care units (ICUs). Methods: Patients who underwent NIV after extubation in the eICU Collaborative Research Database (eICU-CRD) were included. NIV failure was defined as need for invasive ventilatory support (reintubation or tracheotomy) or death after NIV initiation. A total of 93 clinical and laboratory variables were assessed, and the recursive feature elimination algorithm was used to select key features. Hyperparameter optimization was conducted with an automated machine-learning toolkit called Neural Network Intelligence. A machine-learning model called Categorical Boosting (CatBoost) was developed and compared with nine other models. The model was then prospectively validated among patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. Results: Of 929 patients included in the eICU-CRD cohort, 248 (26.7%) had NIV failure. The time from extubation to NIV, age, Glasgow Coma Scale (GCS) score, heart rate, respiratory rate, mean blood pressure (MBP), saturation of pulse oxygen (SpO2), temperature, glucose, pH, pressure of oxygen in blood (PaO2), urine output, input volume, ventilation duration, and mean airway pressure were selected. After hyperparameter optimization, our model showed the greatest accuracy in predicting NIV failure (AUROC: 0.872 [95% CI 0.82-0.92]) among all predictive methods in an internal validation. In the prospective validation cohort, our model was also superior (AUROC: 0.846 [95% CI 0.80-0.89]). The sensitivity and specificity in the prediction group is 89% and 75%, while in the validation group they are 90% and 70%. MV duration and respiratory rate were the most important features. Additionally, we developed a web-based tool to help clinicians use our model. Conclusions: This study developed and prospectively validated the CatBoost model, which can be used to identify patients who are at risk of NIV failure. Thus, those patients might benefit from early triage and more intensive monitoring. Trial registration: NCT03704324. Registered 1 September 2018, https://register. Clinicaltrials: gov .
Development of a machine learning algorithm to predict intubation among hospitalized patients with COVID-19

Varun Arvind,Jun S Kim,Brian H Cho,Eric Geng,Samuel K Cho,Jun S. Kim,Brian H. Cho,Samuel K. Cho

DOI: https://doi.org/10.1016/j.jcrc.2020.10.033

IF: 4.298

2021-04-01

Journal of Critical Care

Abstract:PurposeThe purpose of this study is to develop a machine learning algorithm to predict future intubation among patients diagnosed or suspected with COVID-19.Materials and methodsThis is a retrospective cohort study of patients diagnosed or under investigation for COVID-19. A machine learning algorithm was trained to predict future presence of intubation based on prior vitals, laboratory, and demographic data. Model performance was compared to ROX index, a validated prognostic tool for prediction of mechanical ventilation.Results4087 patients admitted to five hospitals between February 2020 and April 2020 were included. 11.03% of patients were intubated. The machine learning model outperformed the ROX-index, demonstrating an area under the receiver characteristic curve (AUC) of 0.84 and 0.64, and area under the precision-recall curve (AUPRC) of 0.30 and 0.13, respectively. In the Kaplan-Meier analysis, patients alerted by the model were more likely to require intubation during their admission (p < 0.0001).ConclusionIn patients diagnosed or under investigation for COVID-19, machine learning can be used to predict future risk of intubation based on clinical data which are routinely collected and available in clinical setting. Such an approach may facilitate identification of high-risk patients to assist in clinical care.

critical care medicine
Early prediction of need for invasive mechanical ventilation in the neonatal intensive care unit using artificial intelligence and electronic health records: a clinical study

Younga Kim,Hyeongsub Kim,Jaewoo Choi,Kyungjae Cho,Dongjoon Yoo,Yeha Lee,Su Jeong Park,Mun Hui Jeong,Seong Hee Jeong,Kyung Hee Park,Shin-Yun Byun,Taehwa Kim,Sung-Ho Ahn,Woo Hyun Cho,Narae Lee

DOI: https://doi.org/10.1186/s12887-023-04350-1

2023-10-23

Abstract:Background: Respiratory support is crucial for newborns with underdeveloped lung. The clinical outcomes of patients depend on the clinician's ability to recognize the status underlying the presented symptoms and signs. With the increasing number of high-risk infants, artificial intelligence (AI) should be considered as a tool for personalized neonatal care. Continuous monitoring of vital signs is essential in cardiorespiratory care. In this study, we developed deep learning (DL) prediction models for rapid and accurate detection of mechanical ventilation requirements in neonates using electronic health records (EHR). Methods: We utilized data from the neonatal intensive care unit in a single center, collected between March 3, 2012, and March 4, 2022, including 1,394 patient records used for model development, consisting of 505 and 889 patients with and without invasive mechanical ventilation (IMV) support, respectively. The proposed model architecture includes feature embedding using feature-wise fully connected (FC) layers, followed by three bidirectional long short-term memory (LSTM) layers. Results: A mean gestational age (GA) was 36.61 ± 3.25 weeks, and the mean birth weight was 2,734.01 ± 784.98 g. The IMV group had lower GA, birth weight, and longer hospitalization duration than the non-IMV group (P < 0.05). Our proposed model, tested on a dataset from March 4, 2019, to March 4, 2022. The mean AUROC of our proposed model for IMV support prediction performance demonstrated 0.861 (95%CI, 0.853-0.869). It is superior to conventional approaches, such as newborn early warning score systems (NEWS), Random Forest, and eXtreme gradient boosting (XGBoost) with 0.611 (95%CI, 0.600-0.622), 0.837 (95%CI, 0.828-0.845), and 0.0.831 (95%CI, 0.821-0.845), respectively. The highest AUPRC value is shown in the proposed model at 0.327 (95%CI, 0.308-0.347). The proposed model performed more accurate predictions as gestational age decreased. Additionally, the model exhibited the lowest alarm rate while maintaining the same sensitivity level. Conclusion: Deep learning approaches can help accurately standardize the prediction of invasive mechanical ventilation for neonatal patients and facilitate advanced neonatal care. The results of predictive, recall, and alarm performances of the proposed model outperformed the other models.
A Hybrid Decision Tree and Deep Learning Approach Combining Medical Imaging and Electronic Medical Records to Predict Intubation Among Hospitalized Patients With COVID-19: Algorithm Development and Validation

Kim-Anh-Nhi Nguyen,Pranai Tandon,Sahar Ghanavati,Satya Narayana Cheetirala,Prem Timsina,Robert Freeman,David Reich,Matthew A Levin,Madhu Mazumdar,Zahi A Fayad,Arash Kia

DOI: https://doi.org/10.2196/46905

2023-10-26

JMIR Formative Research

Abstract:Background Early prediction of the need for invasive mechanical ventilation (IMV) in patients hospitalized with COVID-19 symptoms can help in the allocation of resources appropriately and improve patient outcomes by appropriately monitoring and treating patients at the greatest risk of respiratory failure. To help with the complexity of deciding whether a patient needs IMV, machine learning algorithms may help bring more prognostic value in a timely and systematic manner. Chest radiographs (CXRs) and electronic medical records (EMRs), typically obtained early in patients admitted with COVID-19, are the keys to deciding whether they need IMV. Objective We aimed to evaluate the use of a machine learning model to predict the need for intubation within 24 hours by using a combination of CXR and EMR data in an end-to-end automated pipeline. We included historical data from 2481 hospitalizations at The Mount Sinai Hospital in New York City. Methods CXRs were first resized, rescaled, and normalized. Then lungs were segmented from the CXRs by using a U-Net algorithm. After splitting them into a training and a test set, the training set images were augmented. The augmented images were used to train an image classifier to predict the probability of intubation with a prediction window of 24 hours by retraining a pretrained DenseNet model by using transfer learning, 10-fold cross-validation, and grid search. Then, in the final fusion model, we trained a random forest algorithm via 10-fold cross-validation by combining the probability score from the image classifier with 41 longitudinal variables in the EMR. Variables in the EMR included clinical and laboratory data routinely collected in the inpatient setting. The final fusion model gave a prediction likelihood for the need of intubation within 24 hours as well. Results At a prediction probability threshold of 0.5, the fusion model provided 78.9% (95% CI 59%-96%) sensitivity, 83% (95% CI 76%-89%) specificity, 0.509 (95% CI 0.34-0.67) F1-score, 0.874 (95% CI 0.80-0.94) area under the receiver operating characteristic curve (AUROC), and 0.497 (95% CI 0.32-0.65) area under the precision recall curve (AUPRC) on the holdout set. Compared to the image classifier alone, which had an AUROC of 0.577 (95% CI 0.44-0.73) and an AUPRC of 0.206 (95% CI 0.08-0.38), the fusion model showed significant improvement (P<.001). The most important predictor variables were respiratory rate, C-reactive protein, oxygen saturation, and lactate dehydrogenase. The imaging probability score ranked 15th in overall feature importance. Conclusions We show that, when linked with EMR data, an automated deep learning image classifier improved performance in identifying hospitalized patients with severe COVID-19 at risk for intubation. With additional prospective and external validation, such a model may assist risk assessment and optimize clinical decision-making in choosing the best care plan during the critical stages of COVID-19.
Prediction of Central Venous Catheter-Associated Deep Venous Thrombosis in Pediatric Critical Care Settings.

Li Haomin,Lu Yang,Zeng Xian,Fu Cangcang,Duan Huilong,Shu Qiang,Zhu Jihua

DOI: https://doi.org/10.1186/s12911-021-01700-w

IF: 3.298

2021-01-01

BMC Medical Informatics and Decision Making

Abstract:Background An increase in the incidence of central venous catheter (CVC)-associated deep venous thrombosis (CADVT) has been reported in pediatric patients over the past decade. At the same time, current screening guidelines for venous thromboembolism risk have low sensitivity for CADVT in hospitalized children. This study utilized a multimodal deep learning model to predict CADVT before it occurs. Methods Children who were admitted to intensive care units (ICUs) between December 2015 and December 2018 and with CVC placement at least 3 days were included. The variables analyzed included demographic characteristics, clinical conditions, laboratory test results, vital signs and medications. A multimodal deep learning (MMDL) model that can handle temporal data using long short-term memory (LSTM) and gated recurrent units (GRUs) was proposed for this prediction task. Four benchmark machine learning models, logistic regression (LR), random forest (RF), gradient boosting decision tree (GBDT) and a published cutting edge MMDL, were used to compare and evaluate the models with a fivefold cross-validation approach. Accuracy, recall, area under the ROC curve (AUC), and average precision (AP) were used to evaluate the discrimination of each model at three time points (24 h, 48 h and 72 h) before CADVT occurred. Brier score and Spiegelhalter's z test were used measure the calibration of these prediction models. Results A total of 1830 patients were included in this study, and approximately 15% developed CADVT. In the CADVT prediction task, the model proposed in this paper significantly outperforms both traditional machine learning models and existing multimodal deep learning models at all 3 time points. It achieved 77% accuracy and 90% recall at 24 h before CADVT was discovered. It can be used to accurately predict the occurrence of CADVT 72 h in advance with an accuracy of greater than 75%, a recall of more than 87%, and an AUC value of 0.82. Conclusion In this study, a machine learning method was successfully established to predict CADVT in advance. These findings demonstrate that artificial intelligence (AI) could provide measures for thromboprophylaxis in a pediatric intensive care setting.
Prognostic Analysis of High-Flow Nasal Cannula Therapy and Non-Invasive Ventilation in Mild to Moderate Hypoxemia Patients and Construction of a Machine Learning Model for 48-H Intubation Prediction—a Retrospective Analysis of the MIMIC Database

Wei Fu,Xiaoqing Liu,Lili Guan,Zhimin Lin,Zhenfeng He,Jianyi Niu,Qiaoyun Huang,Qi Liu,Rongchang Chen

DOI: https://doi.org/10.3389/fmed.2024.1213169

IF: 3.9

2024-01-01

Frontiers in Medicine

Abstract:BackgroundThis study aims to investigate the clinical outcome between high-flow nasal cannula (HFNC) and non-invasive ventilation (NIV) therapy in mild to moderate hypoxemic patients on the first ICU day and to develop a predictive model of 48-h intubation.MethodsThe study included adult patients from the MIMIC III and IV databases who first initiated HFNC or NIV therapy due to mild to moderate hypoxemia (100 < PaO2/FiO2 ≤ 300). The 48-h and 30-day intubation rates were compared using cross-sectional and survival analysis. Nine machine learning and six ensemble algorithms were deployed to construct the 48-h intubation predictive models, of which the optimal model was determined by its prediction accuracy. The top 10 risk and protective factors were identified using the Shapley interpretation algorithm.ResultA total of 123,042 patients were screened, of which, 673 were from the MIMIC IV database for ventilation therapy comparison (HFNC n = 363, NIV n = 310) and 48-h intubation predictive model construction (training dataset n = 471, internal validation set n = 202) and 408 were from the MIMIC III database for external validation. The NIV group had a lower intubation rate (23.1% vs. 16.1%, p = 0.001), ICU 28-day mortality (18.5% vs. 11.6%, p = 0.014), and in-hospital mortality (19.6% vs. 11.9%, p = 0.007) compared to the HFNC group. Survival analysis showed that the total and 48-h intubation rates were not significantly different. The ensemble AdaBoost decision tree model (internal and external validation set AUROC 0.878, 0.726) had the best predictive accuracy performance. The model Shapley algorithm showed Sequential Organ Failure Assessment (SOFA), acute physiology scores (APSIII), the minimum and maximum lactate value as risk factors for early failure and age, the maximum PaCO2 and PH value, Glasgow Coma Scale (GCS), the minimum PaO2/FiO2 ratio, and PaO2 value as protective factors.ConclusionNIV was associated with lower intubation rate and ICU 28-day and in-hospital mortality. Further survival analysis reinforced that the effect of NIV on the intubation rate might partly be attributed to the other impact factors. The ensemble AdaBoost decision tree model may assist clinicians in making clinical decisions, and early organ function support to improve patients’ SOFA, APSIII, GCS, PaCO2, PaO2, PH, PaO2/FiO2 ratio, and lactate values can reduce the early failure rate and improve patient prognosis.
An artificial intelligence system to predict the optimal timing for mechanical ventilation weaning for intensive care unit patients: A two-stage prediction approach

Chung-Feng Liu,Chao-Ming Hung,Shian-Chin Ko,Kuo-Chen Cheng,Chien-Ming Chao,Mei-I Sung,Shu-Chen Hsing,Jhi-Joung Wang,Chia-Jung Chen,Chih-Cheng Lai,Chin-Ming Chen,Chong-Chi Chiu

DOI: https://doi.org/10.3389/fmed.2022.935366

IF: 3.9

2022-11-18

Frontiers in Medicine

Abstract:Background For the intensivists, accurate assessment of the ideal timing for successful weaning from the mechanical ventilation (MV) in the intensive care unit (ICU) is very challenging. Purpose Using artificial intelligence (AI) approach to build two-stage predictive models, namely, the try-weaning stage and weaning MV stage to determine the optimal timing of weaning from MV for ICU intubated patients, and implement into practice for assisting clinical decision making. Methods AI and machine learning (ML) technologies were used to establish the predictive models in the stages. Each stage comprised 11 prediction time points with 11 prediction models. Twenty-five features were used for the first-stage models while 20 features were used for the second-stage models. The optimal models for each time point were selected for further practical implementation in a digital dashboard style. Seven machine learning algorithms including Logistic Regression (LR), Random Forest (RF), Support Vector Machines (SVM), K Nearest Neighbor (KNN), lightGBM, XGBoost, and Multilayer Perception (MLP) were used. The electronic medical records of the intubated ICU patients of Chi Mei Medical Center (CMMC) from 2016 to 2019 were included for modeling. Models with the highest area under the receiver operating characteristic curve (AUC) were regarded as optimal models and used to develop the prediction system accordingly. Results A total of 5,873 cases were included in machine learning modeling for Stage 1 with the AUCs of optimal models ranging from 0.843 to 0.953. Further, 4,172 cases were included for Stage 2 with the AUCs of optimal models ranging from 0.889 to 0.944. A prediction system (dashboard) with the optimal models of the two stages was developed and deployed in the ICU setting. Respiratory care members expressed high recognition of the AI dashboard assisting ventilator weaning decisions. Also, the impact analysis of with- and without-AI assistance revealed that our AI models could shorten the patients’ intubation time by 21 hours, besides gaining the benefit of substantial consistency between these two decision-making strategies. Conclusion We noticed that the two-stage AI prediction models could effectively and precisely predict the optimal timing to wean intubated patients in the ICU from ventilator use. This could reduce patient discomfort, improve medical quality, and lower medical costs. This AI-assisted prediction system is beneficial for clinicians to cope with a high demand for ventilators during the COVID-19 pandemic.

medicine, general & internal
Early Prediction of Multiple Organ Dysfunction in the Pediatric Intensive Care Unit

Sanjukta N Bose,Joseph L Greenstein,James C Fackler,Sridevi V Sarma,Raimond L Winslow,Melania M Bembea

DOI: https://doi.org/10.3389/fped.2021.711104

2021-08-16

Abstract:Objective: The objective of the study is to build models for early prediction of risk for developing multiple organ dysfunction (MOD) in pediatric intensive care unit (PICU) patients. Design: The design of the study is a retrospective observational cohort study. Setting: The setting of the study is at a single academic PICU at the Johns Hopkins Hospital, Baltimore, MD. Patients: The patients included in the study were <18 years of age admitted to the PICU between July 2014 and October 2015. Measurements and main results: Organ dysfunction labels were generated every minute from preceding 24-h time windows using the International Pediatric Sepsis Consensus Conference (IPSCC) and Proulx et al. MOD criteria. Early MOD prediction models were built using four machine learning methods: random forest, XGBoost, GLMBoost, and Lasso-GLM. An optimal threshold learned from training data was used to detect high-risk alert events (HRAs). The early prediction models from all methods achieved an area under the receiver operating characteristics curve ≥0.91 for both IPSCC and Proulx criteria. The best performance in terms of maximum F1-score was achieved with random forest (sensitivity: 0.72, positive predictive value: 0.70, F1-score: 0.71) and XGBoost (sensitivity: 0.8, positive predictive value: 0.81, F1-score: 0.81) for IPSCC and Proulx criteria, respectively. The median early warning time was 22.7 h for random forest and 37 h for XGBoost models for IPSCC and Proulx criteria, respectively. Applying spectral clustering on risk-score trajectories over 24 h following early warning provided a high-risk group with ≥0.93 positive predictive value. Conclusions: Early predictions from risk-based patient monitoring could provide more than 22 h of lead time for MOD onset, with ≥0.93 positive predictive value for a high-risk group identified pre-MOD.
Predicting time-to-intubation after critical care admission using machine learning and cured fraction information

Michela Venturini,Ingrid Van Keilegom,Wouter De Corte,Celine Vens

DOI: https://doi.org/10.1016/j.artmed.2024.102817

IF: 7.011

2024-02-24

Artificial Intelligence in Medicine

Abstract:Intubation for mechanical ventilation (MV) is one of the most common high-risk procedures performed in Intensive Care Units (ICUs). Early prediction of intubation may have a positive impact by providing timely alerts to clinicians and consequently avoiding high-risk late intubations. In this work, we propose a new machine learning method to predict the time to intubation during the first five days of ICU admission, based on the concept of cure survival models. Our approach combines classification and survival analysis, to effectively accommodate the fraction of patients not at risk of intubation, and provide a better estimate of time to intubation, for patients at risk. We tested our approach and compared it to other predictive models on a dataset collected from a secondary care hospital (AZ Groeninge, Kortrijk, Belgium) from 2015 to 2021, consisting of 3425 ICU stays. Furthermore, we utilized SHAP for feature importance analysis, extracting key insights into the relative significance of variables such as vital signs, blood gases, and patient characteristics in predicting intubation in ICU settings. The results corroborate that our approach improves the prediction of time to intubation in critically ill patients, by using routinely collected data within the first hours of admission in the ICU. Early warning of the need for intubation may be used to help clinicians predict the risk of intubation and rank patients according to their expected time to intubation.

engineering, biomedical,computer science, artificial intelligence,medical informatics
Development and Prospective Validation of a Transparent Deep Learning Algorithm for Predicting Need for Mechanical Ventilation

Supreeth P. Shashikumar,Gabriel Wardi,Paulina Paul,Paulina Paul,Morgan Carlile,Laura N Brenner,Kathryn A Hibbert,Crystal M. North,Shibani S. Mukerji,Gregory K. Robbins,Yu-Ping Shao,Atul Malhotra,M. Brandon Westover,Shamim Nemati

DOI: https://doi.org/10.1101/2020.05.30.20118109

2020-06-03

Abstract:ABSTRACT IMPORTANCE Objective and early identification of hospitalized patients, and particularly those with novel coronavirus disease 2019 (COVID-19), who may require mechanical ventilation is of great importance and may aid in delivering timely treatment. OBJECTIVE To develop, externally validate and prospectively test a transparent deep learning algorithm for predicting 24 hours in advance the need for mechanical ventilation in hospitalized patients and those with COVID-19. DESIGN Observational cohort study SETTING Two academic medical centers from January 01, 2016 to December 31, 2019 (Retrospective cohorts) and February 10, 2020 to May 4, 2020 (Prospective cohorts). PARTICIPANTS Over 31,000 admissions to the intensive care units (ICUs) at two hospitals. Additionally, 777 patients with COVID-19 patients were used for prospective validation. Patients who were placed on mechanical ventilation within four hours of their admission were excluded. MAIN OUTCOME(S) and MEASURE(S) Electronic health record (EHR) data were extracted on an hourly basis, and a set of 40 features were calculated and passed to an interpretable deep-learning algorithm to predict the future need for mechanical ventilation 24 hours in advance. Additionally, commonly used clinical criteria (based on heart rate, oxygen saturation, respiratory rate, FiO 2 and pH) was used to assess future need for mechanical ventilation. Performance of the algorithms were evaluated using the area under receiver-operating characteristic curve (AUC), sensitivity, specificity and positive predictive value. RESULTS After applying exclusion criteria, the external validation cohort included 3,888 general ICU and 402 COVID-19 patients. The performance of the model (AUC) with a 24-hour prediction horizon at the validation site was 0.882 for the general ICU population and 0.918 for patients with COVID-19. In comparison, commonly used clinical criteria and the ROX score achieved AUCs in the range of 0.773 – 0.782 and 0.768 – 0.810 for the general ICU population and patients with COVID-19, respectively. CONCLUSIONS and RELEVANCE A generalizable and transparent deep-learning algorithm improves on traditional clinical criteria to predict the need for mechanical ventilation in hospitalized patients, including those with COVID-19. Such an algorithm may help clinicians with optimizing timing of tracheal intubation, better allocation of mechanical ventilation resources and staff, and improve patient care.
A machine learning-based prediction of hospital mortality in mechanically ventilated ICU patients

Hexin Li,Negin Ashrafi,Chris Kang,Guanlan Zhao,Yubing Chen,Maryam Pishgar

DOI: https://doi.org/10.1371/journal.pone.0309383

IF: 3.7

2024-09-05

PLoS ONE

Abstract:Mechanical ventilation (MV) is vital for critically ill ICU patients but carries significant mortality risks. This study aims to develop a predictive model to estimate hospital mortality among MV patients, utilizing comprehensive health data to assist ICU physicians with early-stage alerts. We developed a Machine Learning (ML) framework to predict hospital mortality in ICU patients receiving MV. Using the MIMIC-III database, we identified 25,202 eligible patients through ICD-9 codes. We employed backward elimination and the Lasso method, selecting 32 features based on clinical insights and literature. Data preprocessing included eliminating columns with over 90% missing data and using mean imputation for the remaining missing values. To address class imbalance, we used the Synthetic Minority Over-sampling Technique (SMOTE). We evaluated several ML models, including CatBoost, XGBoost, Decision Tree, Random Forest, Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Logistic Regression, using a 70/30 train-test split. The CatBoost model was chosen for its superior performance in terms of accuracy, precision, recall, F1-score, AUROC metrics, and calibration plots. The study involved a cohort of 25,202 patients on MV. The CatBoost model attained an AUROC of 0.862, an increase from an initial AUROC of 0.821, which was the best reported in the literature. It also demonstrated an accuracy of 0.789, an F1-score of 0.747, and better calibration, outperforming other models. These improvements are due to systematic feature selection and the robust gradient boosting architecture of CatBoost. The preprocessing methodology significantly reduced the number of relevant features, simplifying computational processes, and identified critical features previously overlooked. Integrating these features and tuning the parameters, our model demonstrated strong generalization to unseen data. This highlights the potential of ML as a crucial tool in ICUs, enhancing resource allocation and providing more personalized interventions for MV patients.

multidisciplinary sciences
Early Prediction of Ventilator-Associated Pneumonia in ICU Patients Using An Interpretable Machine Learning Algorithm

Maxime Faucher,Satish Casie Chetty,Sepideh Shokouhi,Gina Barnes,Keyvan Rahmani,Jacob Calvert,Qingqing Mao

DOI: https://doi.org/10.20944/preprints202206.0149.v1

2022-01-01

Abstract:(1) Background: Ventilator-associated pneumonia (VAP) causes high mortality among patients with respiratory disease and imposes major burdens on healthcare infrastructure. Models that use electronic health record data to predict the onset of VAP may spur earlier treatment and improve patient outcomes. We developed and studied the performance of interpretable machine learning (ML) models that predict the onset of VAP from electronic health records (EHRs); (2) Methods: We trained Logistic Regression (LR), full feature Explainable Boosting Machine (fEBM), and eXtreme Gradient Boosting (XGBoost) ML models on data from the MIMIC- III (v1.3) database. Model performance was measured by area under the receiver operating characteristic curves (AUCs). We trained a minimal-feature EBM model (mEBM) with features derived from white blood cell (WBC) counts, duration of ventilation, and Glasgow Coma Scale (GCS). Finally, model robustness was evaluated on randomly sparsified EHR datasets; (3) Results: The fEBM model outperformed the XGBoost and LR models at 24 hours post-intubation. The mEBM model maintained an AUC of 0.893. The fEBM model performance remained robust on sparsified datasets; (4) Conclusions: Our novel interpretable ML algorithm reliably predicts the onset of VAP in intubated patients. Integration of this EBM-based model into clinical practice may enable clinicians to better anticipate and prevent VAP.
Adding Continuous Vital Sign Information to Static Clinical Data Improves the Prediction of Length of Stay After Intubation: A Data-Driven Machine Learning Approach

David Castiñeira,Katherine R Schlosser,Alon Geva,Amir R Rahmani,Gaston Fiore,Brian K Walsh,Craig D Smallwood,John H Arnold,Mauricio Santillana

DOI: https://doi.org/10.4187/respcare.07561

2020-09-01

Respiratory Care

Abstract:BACKGROUND:Bedside monitors in the ICU routinely measure and collect patients' physiologic data in real time to continuously assess the health status of patients who are critically ill. With the advent of increased computational power and the ability to store and rapidly process big data sets in recent years, these physiologic data show promise in identifying specific outcomes and/or events during patients' ICU hospitalization.METHODS:We introduced a methodology designed to automatically extract information from continuous-in-time vital sign data collected from bedside monitors to predict if a patient will experience a prolonged stay (length of stay) on mechanical ventilation, defined as >4 d, in a pediatric ICU.RESULTS:Continuous-in-time vital signs information and clinical history data were retrospectively collected for 284 ICU subjects from their first 24 h on mechanical ventilation from a medical-surgical pediatric ICU at Boston Children's Hospital. Multiple machine learning models were trained on multiple subsets of these subjects to predict the likelihood that each of these subjects would experience a long stay. We evaluated the predictive power of our models strictly on unseen hold-out validation sets of subjects. Our methodology achieved model performance of >83% (area under the curve) by using only vital sign information as input, and performances of 90% (area under the curve) by combining vital sign information with subjects' static clinical data readily available in electronic health records. We implemented this approach on 300 independently trained experiments with different choices of training and hold-out validation sets to ensure the consistency and robustness of our results in our study sample. The predictive power of our approach outperformed recent efforts that used deep learning to predict a similar task.CONCLUSIONS:Our proposed workflow may prove useful in the design of scalable approaches for real-time predictive systems in ICU environments, exploiting real-time vital sign information from bedside monitors. (ClinicalTrials.gov registration NCT02184208.)

respiratory system,critical care medicine
Development and Validation of a Deep Learning Classifier Using Chest Radiographs to Predict Extubation Success in Patients Undergoing Invasive Mechanical Ventilation

Pranai Tandon,Kim-Anh-Nhi Nguyen,Masoud Edalati,Prathamesh Parchure,Ganesh Raut,David L Reich,Robert Freeman,Matthew A Levin,Prem Timsina,Charles A Powell,Zahi A Fayad,Arash Kia

DOI: https://doi.org/10.3390/bioengineering11060626

2024-06-19

Abstract:The decision to extubate patients on invasive mechanical ventilation is critical; however, clinician performance in identifying patients to liberate from the ventilator is poor. Machine Learning-based predictors using tabular data have been developed; however, these fail to capture the wide spectrum of data available. Here, we develop and validate a deep learning-based model using routinely collected chest X-rays to predict the outcome of attempted extubation. We included 2288 serial patients admitted to the Medical ICU at an urban academic medical center, who underwent invasive mechanical ventilation, with at least one intubated CXR, and a documented extubation attempt. The last CXR before extubation for each patient was taken and split 79/21 for training/testing sets, then transfer learning with k-fold cross-validation was used on a pre-trained ResNet50 deep learning architecture. The top three models were ensembled to form a final classifier. The Grad-CAM technique was used to visualize image regions driving predictions. The model achieved an AUC of 0.66, AUPRC of 0.94, sensitivity of 0.62, and specificity of 0.60. The model performance was improved compared to the Rapid Shallow Breathing Index (AUC 0.61) and the only identified previous study in this domain (AUC 0.55), but significant room for improvement and experimentation remains.
Developing a machine-learning model for real-time prediction of successful extubation in mechanically ventilated patients using time-series ventilator-derived parameters

Kuo-Yang Huang,Ying-Lin Hsu,Huang-Chi Chen,Ming-Hwarng Horng,Che-Liang Chung,Ching-Hsiung Lin,Jia-Lang Xu,Ming-Hon Hou

DOI: https://doi.org/10.3389/fmed.2023.1167445

IF: 3.9

2023-05-09

Frontiers in Medicine

Abstract:Background Successful weaning from mechanical ventilation is important for patients admitted to intensive care units. However, models for predicting real-time weaning outcomes remain inadequate. Therefore, this study aimed to develop a machine-learning model for predicting successful extubation only using time-series ventilator-derived parameters with good accuracy. Methods Patients with mechanical ventilation admitted to the Yuanlin Christian Hospital in Taiwan between August 2015 and November 2020 were retrospectively included. A dataset with ventilator-derived parameters was obtained before extubation. Recursive feature elimination was applied to select the most important features. Machine-learning models of logistic regression, random forest (RF), and support vector machine were adopted to predict extubation outcomes. In addition, the synthetic minority oversampling technique (SMOTE) was employed to address the data imbalance problem. The area under the receiver operating characteristic (AUC), F1 score, and accuracy, along with the 10-fold cross-validation, were used to evaluate prediction performance. Results In this study, 233 patients were included, of whom 28 (12.0%) failed extubation. The six ventilatory variables per 180 s dataset had optimal feature importance. RF exhibited better performance than the others, with an AUC value of 0.976 (95% confidence interval [CI], 0.975–0.976), accuracy of 94.0% (95% CI, 93.8–94.3%), and an F1 score of 95.8% (95% CI, 95.7–96.0%). The difference in performance between the RF and the original and SMOTE datasets was small. Conclusion The RF model demonstrated a good performance in predicting successful extubation in mechanically ventilated patients. This algorithm made a precise real-time extubation outcome prediction for patients at different time points.

medicine, general & internal
Predicting Extubation Readiness in Extreme Preterm Infants based on Patterns of Breathing

Charles C. Onu,Lara J. Kanbar,Wissam Shalish,Karen A. Brown,Guilherme M. Sant'Anna,Robert E. Kearney,Doina Precup

DOI: https://doi.org/10.48550/arXiv.1808.07991

2018-08-24

Abstract:Extremely preterm infants commonly require intubation and invasive mechanical ventilation after birth. While the duration of mechanical ventilation should be minimized in order to avoid complications, extubation failure is associated with increases in morbidities and mortality. As part of a prospective observational study aimed at developing an accurate predictor of extubation readiness, Markov and semi-Markov chain models were applied to gain insight into the respiratory patterns of these infants, with more robust time-series modeling using semi-Markov models. This model revealed interesting similarities and differences between newborns who succeeded extubation and those who failed. The parameters of the model were further applied to predict extubation readiness via generative (joint likelihood) and discriminative (support vector machine) approaches. Results showed that up to 84\% of infants who failed extubation could have been accurately identified prior to extubation.

Machine Learning,Signal Processing

On the planarity of iterated jump graphs

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Development and external validation of an interpretable machine learning model for the prediction of intubation in the intensive care unit

Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A 4‐year Single‐center Retrospective Analysis

Early prediction of noninvasive ventilation failure after extubation: development and validation of a machine-learning model

Development of a machine learning algorithm to predict intubation among hospitalized patients with COVID-19

Early prediction of need for invasive mechanical ventilation in the neonatal intensive care unit using artificial intelligence and electronic health records: a clinical study

A Hybrid Decision Tree and Deep Learning Approach Combining Medical Imaging and Electronic Medical Records to Predict Intubation Among Hospitalized Patients With COVID-19: Algorithm Development and Validation

Prediction of Central Venous Catheter-Associated Deep Venous Thrombosis in Pediatric Critical Care Settings.

Prognostic Analysis of High-Flow Nasal Cannula Therapy and Non-Invasive Ventilation in Mild to Moderate Hypoxemia Patients and Construction of a Machine Learning Model for 48-H Intubation Prediction—a Retrospective Analysis of the MIMIC Database

An artificial intelligence system to predict the optimal timing for mechanical ventilation weaning for intensive care unit patients: A two-stage prediction approach

Early Prediction of Multiple Organ Dysfunction in the Pediatric Intensive Care Unit

Predicting time-to-intubation after critical care admission using machine learning and cured fraction information

Development and Prospective Validation of a Transparent Deep Learning Algorithm for Predicting Need for Mechanical Ventilation

A machine learning-based prediction of hospital mortality in mechanically ventilated ICU patients

Early Prediction of Ventilator-Associated Pneumonia in ICU Patients Using An Interpretable Machine Learning Algorithm

Adding Continuous Vital Sign Information to Static Clinical Data Improves the Prediction of Length of Stay After Intubation: A Data-Driven Machine Learning Approach

Development and Validation of a Deep Learning Classifier Using Chest Radiographs to Predict Extubation Success in Patients Undergoing Invasive Mechanical Ventilation

Developing a machine-learning model for real-time prediction of successful extubation in mechanically ventilated patients using time-series ventilator-derived parameters

Predicting Extubation Readiness in Extreme Preterm Infants based on Patterns of Breathing