Abstract:The unprecedented global crisis brought about by the COVID-19 pandemic has sparked numerous efforts to create predictive models for the detection and prognostication of SARS-CoV-2 infections with the goal of helping health systems allocate resources. Machine learning models, in particular, hold promise for their ability to leverage patient clinical information and medical images for prediction. However, most of the published COVID-19 prediction models thus far have little clinical utility due to methodological flaws and lack of appropriate validation. In this paper, we describe our methodology to develop and validate multi-modal models for COVID-19 mortality prediction using multi-center patient data. The models for COVID-19 mortality prediction were developed using retrospective data from Madrid, Spain ( N = 2547) and were externally validated in patient cohorts from a community hospital in New Jersey, USA ( N = 242) and an academic center in Seoul, Republic of Korea ( N = 336). The models we developed performed differently across various clinical settings, underscoring the need for a guided strategy when employing machine learning for clinical decision-making. We demonstrated that using features from both the structured electronic health records and chest X-ray imaging data resulted in better 30-day mortality prediction performance across all three datasets (areas under the receiver operating characteristic curves: 0.85 (95% confidence interval: 0.83–0.87), 0.76 (0.70–0.82), and 0.95 (0.92–0.98)). We discuss the rationale for the decisions made at every step in developing the models and have made our code available to the research community. We employed the best machine learning practices for clinical model development. Our goal is to create a toolkit that would assist investigators and organizations in building multi-modal models for prediction, classification, and/or optimization.

Bayesian poisson regression tensor train decomposition model for learning mortality pattern changes during COVID-19 pandemic

Bayesian Poisson Regression and Tensor Train Decomposition Model for Learning Mortality Pattern Changes during COVID-19 Pandemic

Bayesian Dynamic Generalized Additive Model for Mortality during COVID-19 Pandemic

A Bayesian Spatio-Temporal Extension to Poisson Auto-Regression: Modeling the Disease Infection Rate of COVID-19 in England

Spatial-temporal generalized additive model for modeling COVID-19 mortality risk in Toronto, Canada

A multivariate statistical approach to predict COVID‐19 count data with epidemiological interpretation and uncertainty quantification

Assessing Excess Mortality in Times of Pandemics Based on Principal Component Analysis of Weekly Mortality Data -- The Case of COVID-19

Advanced Techniques in Mortality Trend Estimation: Integrating Generalized Additive Models and Machine Learning to Evaluate the COVID-19 Impact

A Two-Layer Nested Heterogeneous Ensemble Learning Predictive Method for COVID-19 Mortality.

Decomposing mechanisms of COVID-19 mortality in empirical datasets: A modeling study

Prediction Regions for Poisson and Over-Dispersed Poisson Regression Models with Applications to Forecasting Number of Deaths during the COVID-19 Pandemic

Developing and Validating Multi-Modal Models for Mortality Prediction in COVID-19 Patients: a Multi-center Retrospective Study

A new time-varying coefficient regression approach for analyzing infectious disease data

High-resolution Spatio-temporal Model for County-level COVID-19 Activity in the U.S

COVID-19 mortality analysis from soft-data multivariate curve regression and machine learning

Bayesian Spatio-Temporal Modeling of the Dynamics of COVID-19 Deaths in Peru

Regularised B-splines projected Gaussian Process priors to estimate time-trends of age-specific COVID-19 deaths related to vaccine roll-out

A Hierarchical Bayesian Model for Stochastic Spatiotemporal SIR Modeling and Prediction of COVID-19 Cases and Hospitalizations

Fusing Low-Latency Data Feeds with Death Data to Accurately Nowcast COVID-19 Related Deaths

Spatial Modeling of Sociodemographic Risk for COVID-19 Mortality