Abstract:Background Chest x-ray is a relatively accessible, inexpensive, fast imaging modality that might be valuable in the prognostication of patients with COVID-19. We aimed to develop and evaluate an artificial intelligence system using chest x-rays and clinical data to predict disease severity and progression in patients with COVID-19. Methods We did a retrospective study in multiple hospitals in the University of Pennsylvania Health System in Philadelphia, PA, USA, and Brown University affiliated hospitals in Providence, RI, USA. Patients who presented to a hospital in the University of Pennsylvania Health System via the emergency department, with a diagnosis of COVID-19 confirmed by RT-PCR and with an available chest x-ray from their initial presentation or admission, were retrospectively identified and randomly divided into training, validation, and test sets (7:1:2). Using the chest x-rays as input to an EfficientNet deep neural network and clinical data, models were trained to predict the binary outcome of disease severity (ie, critical or noncritical). The deep-learning features extracted from the model and clinical data were used to build time-to-event models to predict the risk of disease progression. The models were externally tested on patients who presented to an independent multicentre institution, Brown University affiliated hospitals, and compared with severity scores provided by radiologists. Findings 1834 patients who presented via the University of Pennsylvania Health System between March 9 and July 20, 2020, were identified and assigned to the model training (n=1285), validation (n=183), or testing (n=366) sets. 475 patients who presented via the Brown University affiliated hospitals between March 1 and July 18, 2020, were identified for external testing of the models. When chest x-rays were added to clinical data for severity prediction, area under the receiver operating characteristic curve (ROC-AUC) increased from 0.821 (95% CI 0.796-0.828) to 0.846 (0.815-0.852; p<0.0001) on internal testing and 0.731 (0.712-0.738) to 0.792 (0.780-0 .803; p<0.0001) on external testing. When deep-learning features were added to clinical data for progression prediction, the concordance index (C-index) increased from 0.769 (0.755-0.786) to 0.805 (0.800-0.820; p<0.0001) on internal testing and 0.707 (0.695-0.729) to 0.752 (0.739-0.764; p<0.0001) on external testing. The image and clinical data combined model had significantly better prognostic performance than combined severity scores and clinical data on internal testing (C-index 0.805 vs 0.781; p=0.0002) and external testing (C-index 0.752 vs 0.715; p<0.0001). Interpretation In patients with COVID-19, artificial intelligence based on chest x-rays had better prognostic performance than clinical data or radiologist-derived severity scores. Using artificial intelligence, chest x-rays can augment clinical data in predicting the risk of progression to critical illness in patients with COVID-19. Copyright (C) 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license.

Prognostication of Patients with COVID-19 Using Artificial Intelligence Based on Chest X-Rays and Clinical Data: a Retrospective Study.

Artificial intelligence for prediction of COVID-19 progression using CT imaging and clinical data

A Prospective Observational Study to Investigate Performance of a Chest X-ray Artificial Intelligence Diagnostic Support Tool Across 12 U.S. Hospitals

An automated COVID-19 triage pipeline using artificial intelligence based on chest radiographs and clinical data

Predicting COVID-19 Pneumonia Severity on Chest X-ray With Deep Learning

Initial chest radiographs and artificial intelligence (AI) predict clinical outcomes in COVID-19 patients: analysis of 697 Italian patients

Predicting Clinical Outcomes in COVID-19 using Radiomics and Deep Learning on Chest Radiographs: A Multi-Institutional Study

CovidAID: COVID-19 Detection Using Chest X-Ray

Deep Neural Network Augments Performance of Junior Residents in Diagnosing COVID-19 Pneumonia on Chest Radiographs

Prognosis of COVID-19 using Artificial Intelligence: A Systematic Review and Meta-analysis

Machine Learning Based on Clinical Variables and Chest CT Quantitative Measurements for Early Prediction of Progression Risk in COVID-19 Patients: A Multicentre Study

Artificial Intelligence Applied to Chest X-ray for Differential Diagnosis of COVID-19 Pneumonia

Development and External Validation of an Artificial Intelligence-Based Method for Scalable Chest Radiograph Diagnosis: A Multi-Country Cross-Sectional Study

Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CT

COVID-19 Mortality Prediction in the Intensive Care Unit with Deep Learning Based on Longitudinal Chest X-rays and Clinical Data

Prediction of COVID-19 Severity Using Chest Computed Tomography and Laboratory Measurements: Evaluation Using a Machine Learning Approach

Development and Evaluation of an Artificial Intelligence System for COVID-19 Diagnosis.

Prediction of Patient Management in COVID-19 Using Deep Learning-Based Fully Automated Extraction of Cardiothoracic CT Metrics and Laboratory Findings

Early assessment of lung function in coronavirus patients using invariant markers from chest X-rays images

Prediction of COVID-19 using chest X-ray images

Detection of COVID-19 Using Deep Learning Algorithms on Chest Radiographs