Abstract:BACKGROUND For the clinical care of patients with well-established diseases, randomized trials, literature, and research are supplemented with clinical judgment to understand disease prognosis and inform treatment choices. In the void created by a lack of clinical experience with COVID-19, artificial intelligence (AI) may be an important tool to bolster clinical judgment and decision making. However, a lack of clinical data restricts the design and development of such AI tools, particularly in preparation for an impending crisis or pandemic. OBJECTIVE This study aimed to develop and test the feasibility of a “patients-like-me” framework to predict the deterioration of patients with COVID-19 using a retrospective cohort of patients with similar respiratory diseases. METHODS Our framework used COVID-19–like cohorts to design and train AI models that were then validated on the COVID-19 population. The COVID-19–like cohorts included patients diagnosed with bacterial pneumonia, viral pneumonia, unspecified pneumonia, influenza, and acute respiratory distress syndrome (ARDS) at an academic medical center from 2008 to 2019. In total, 15 training cohorts were created using different combinations of the COVID-19–like cohorts with the ARDS cohort for exploratory purposes. In this study, two machine learning models were developed: one to predict invasive mechanical ventilation (IMV) within 48 hours for each hospitalized day, and one to predict all-cause mortality at the time of admission. Model performance was assessed using the area under the receiver operating characteristic curve (AUROC), sensitivity, specificity, positive predictive value, and negative predictive value. We established model interpretability by calculating SHapley Additive exPlanations (SHAP) scores to identify important features. RESULTS Compared to the COVID-19–like cohorts (n=16,509), the patients hospitalized with COVID-19 (n=159) were significantly younger, with a higher proportion of patients of Hispanic ethnicity, a lower proportion of patients with smoking history, and fewer patients with comorbidities ( P <.001). Patients with COVID-19 had a lower IMV rate (15.1 versus 23.2, P =.02) and shorter time to IMV (2.9 versus 4.1 days, P <.001) compared to the COVID-19–like patients. In the COVID-19–like training data, the top models achieved excellent performance (AUROC>0.90). Validating in the COVID-19 cohort, the top-performing model for predicting IMV was the XGBoost model (AUROC=0.826) trained on the viral pneumonia cohort. Similarly, the XGBoost model trained on all 4 COVID-19–like cohorts without ARDS achieved the best performance (AUROC=0.928) in predicting mortality. Important predictors included demographic information (age), vital signs (oxygen saturation), and laboratory values (white blood cell count, cardiac troponin, albumin, etc). Our models had class imbalance, which resulted in high negative predictive values and low positive predictive values. CONCLUSIONS We provided a feasible framework for modeling patient deterioration using existing data and AI technology to address data limitations during the onset of a novel, rapidly changing pandemic.

Predicting invasive mechanical ventilation in COVID 19 patients: A validation study

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Development and validation of a prediction model for mechanical ventilation based on comorbidities in hospitalized patients with COVID-19

Development of a machine learning algorithm to predict intubation among hospitalized patients with COVID-19

Development and Prospective Validation of a Transparent Deep Learning Algorithm for Predicting Need for Mechanical Ventilation

Derivation and external validation of predictive models for invasive mechanical ventilation in intensive care unit patients with COVID-19

Early prediction of noninvasive ventilation failure after extubation: development and validation of a machine-learning model

A Hybrid Decision Tree and Deep Learning Approach Combining Medical Imaging and Electronic Medical Records to Predict Intubation Among Hospitalized Patients With COVID-19: Algorithm Development and Validation

Assessment of respiratory support decision and the outcome of invasive mechanical ventilation in severe COVID-19 with ARDS

Learning From Past Respiratory Infections to Predict COVID-19 Outcomes: Retrospective Study

Learning From Past Respiratory Infections to Predict COVID-19 Outcomes: Retrospective Study (Preprint)

The role of electrical impedance tomography in predicting the failure of non-invasive ventilation in patients with COVID-19-associated hypoxemic acute respiratory failure: a prospective observational study

Risk stratification and prediction of severity of COVID-19 infection in patients with preexisting cardiovascular disease

Intelligent alert system for predicting invasive mechanical ventilation needs via noninvasive parameters: employing an integrated machine learning method with integration of multicenter databases

Early identification of patients admitted to hospital for covid-19 at risk of clinical deterioration: model development and multisite external validation study

Machine learning-based derivation and external validation of a tool to predict death and development of organ failure in hospitalized patients with COVID-19

Predictive Factors of Oxygen Therapy Failure in Patients with COVID-19 in the Emergency Department

Integrated Clinical and CT Based Artificial Intelligence Nomogram for Predicting Severity and Need for Ventilator Support in COVID-19 Patients: A Multi-Site Study

Deep learning model to predict the need for mechanical ventilation using chest X-ray images in hospitalised patients with COVID-19

Development and Validation of a Model for Endotracheal Intubation and Mechanical Ventilation Prediction in PICU Patients

Risk Index-Based Ventilator Prediction System for COVID-19 Infection