Abstract:Background For the clinical care of patients with well-established diseases, randomized trials, literature, and research are supplemented with clinical judgment to understand disease prognosis and inform treatment choices. In the void created by a lack of clinical experience with COVID-19, artificial intelligence (AI) may be an important tool to bolster clinical judgment and decision making. However, a lack of clinical data restricts the design and development of such AI tools, particularly in preparation for an impending crisis or pandemic. Objective This study aimed to develop and test the feasibility of a “patients-like-me” framework to predict the deterioration of patients with COVID-19 using a retrospective cohort of patients with similar respiratory diseases. Methods Our framework used COVID-19–like cohorts to design and train AI models that were then validated on the COVID-19 population. The COVID-19–like cohorts included patients diagnosed with bacterial pneumonia, viral pneumonia, unspecified pneumonia, influenza, and acute respiratory distress syndrome (ARDS) at an academic medical center from 2008 to 2019. In total, 15 training cohorts were created using different combinations of the COVID-19–like cohorts with the ARDS cohort for exploratory purposes. In this study, two machine learning models were developed: one to predict invasive mechanical ventilation (IMV) within 48 hours for each hospitalized day, and one to predict all-cause mortality at the time of admission. Model performance was assessed using the area under the receiver operating characteristic curve (AUROC), sensitivity, specificity, positive predictive value, and negative predictive value. We established model interpretability by calculating SHapley Additive exPlanations (SHAP) scores to identify important features. Results Compared to the COVID-19–like cohorts (n=16,509), the patients hospitalized with COVID-19 (n=159) were significantly younger, with a higher proportion of patients of Hispanic ethnicity, a lower proportion of patients with smoking history, and fewer patients with comorbidities (P<.001). Patients with COVID-19 had a lower IMV rate (15.1 versus 23.2, P=.02) and shorter time to IMV (2.9 versus 4.1 days, P 0.90). Validating in the COVID-19 cohort, the top-performing model for predicting IMV was the XGBoost model (AUROC=0.826) trained on the viral pneumonia cohort. Similarly, the XGBoost model trained on all 4 COVID-19–like cohorts without ARDS achieved the best performance (AUROC=0.928) in predicting mortality. Important predictors included demographic information (age), vital signs (oxygen saturation), and laboratory values (white blood cell count, cardiac troponin, albumin, etc). Our models had class imbalance, which resulted in high negative predictive values and low positive predictive values. Conclusions We provided a feasible framework for modeling patient deterioration using existing data and AI technology to address data limitations during the onset of a novel, rapidly changing pandemic.

Development of a new prognostic model to predict pneumonia outcome using artificial intelligence-based chest radiograph results

A new prediction model for assessing the clinical outcomes of ICU patients with community-acquired pneumonia: a decision tree analysis.

Predicting Omicron Pneumonia Severity and Outcome: a Single-Center Study in Hangzhou, China

Development of a new prognostic index PNPI for prognosis prediction of CKD patients with pneumonia at hospital admission

Correlation between oxygenation function and laboratory indicators in COVID-19 patients based on non-enhanced chest CT images and construction of an artificial intelligence prediction model

Validating the accuracy of deep learning for the diagnosis of pneumonia on chest x-ray against a robust multimodal reference diagnosis: a post hoc analysis of two prospective studies

Deep Neural Network Augments Performance of Junior Residents in Diagnosing COVID-19 Pneumonia on Chest Radiographs

Cluster analysis of thoracic muscle mass using artificial intelligence in severe pneumonia

A Prospective Observational Study to Investigate Performance of a Chest X-ray Artificial Intelligence Diagnostic Support Tool Across 12 U.S. Hospitals

Development and validation of machine learning-based prediction model for severe pneumonia: A multicenter cohort study

Mortality and Prognostic Prediction in Very Elderly Patients With Severe Pneumonia

Factors for increasing positive predictive value of pneumothorax detection on chest radiographs using artificial intelligence

A deep learning-based model for screening and staging pneumoconiosis

Learning From Past Respiratory Infections to Predict COVID-19 Outcomes: Retrospective Study

Risk factors analysis and prediction model construction for severe pneumonia in older adult patients

Integrating ensemble and machine learning models for early prediction of pneumonia mortality using laboratory tests

Model based on the automated AI-driven CT quantification is effective for the diagnosis of refractory Mycoplasma pneumoniae pneumonia

Predicting COVID-19 Pneumonia Severity on Chest X-ray With Deep Learning

Performance and Comparison of Assessment Models to Predict 30-Day Mortality in Patients with Hospital-Acquired Pneumonia

An AI-based radiomics nomogram for disease prognosis in patients with COVID-19 pneumonia using initial CT images and clinical indicators

Machine learning-based CT radiomics model for predicting hospital stay in patients with pneumonia associated with SARS-CoV-2 infection: A multicenter study