COVID-19 ICU mortality prediction: a machine learning approach using SuperLearner algorithm
Giulia Lorenzoni,Nicolò Sella,Annalisa Boscolo,Danila Azzolina,Patrizia Bartolotta,Laura Pasin,Tommaso Pettenuzzo,Alessandro De Cassai,Fabio Baratto,Fabio Toffoletto,Silvia De Rosa,Giorgio Fullin,Mario Peta,Paolo Rosi,Enrico Polati,Alberto Zanella,Giacomo Grasselli,Antonio Pesenti,Paolo Navalesi,Dario Gregori,VENETO ICU Network,Martina Tocco,Chiara Pretto,Enrico Tamburini,Davide Fregolent,Pier Francesco Pirelli,Davide Marchesin,Matteo Perona,Nicola Franchetti,Michele Della Paolera,Caterina Simoni,Tatiana Falcioni,Alessandra Tresin,Chiara Schiavolin,Aldo Schiavi,Sonila Vathi,Daria Sartori,Alice Sorgato,Elisa Pistollato,Federico Linassi,Sara Gianoli,Silvia Gaspari,Francesco Gruppo,Alessandra Maggiolo,Elena Giurisato,Elisa Furlani,Alvise Calore,Eugenio Serra,Demetrio Pittarello,Ivo Tiberio,Ottavia Bond,Elisa Michieletto,Luisa Muraro,Arianna Peralta,Paolo Persona,Enrico Petranzan,Francesco Zarantonello,Alessandro Graziano,Eleonora Piasentini,Lorenzo Bernardi,Roberto Pianon,Davide Mazzon,Daniele Poole,Flavio Badii,Enrico Bosco,Moreno Agostini,Paride Trevisiol,Antonio Farnia,Lorella Altafini,Mauro Antonio Calò,Marco Meggiolaro,Francesco Lazzari,Ivan Martinello,Francesco Papaccio,Guido di Gregorio,Alfeo Bonato,Camilla Sgarabotto,Francesco Montacciani,Parnigotto Alessandra,Giuseppe Gagliardi,Gioconda Ferraro,Luigi Ongaro,Marco Baiocchi,Vinicio Danzi,Paolo Zanatta,Katia Donadello,Leonardo Gottin,Ezio Sinigaglia,Alessandra da Ros,Simonetta Marchiotto,Silvia Bassanini,Massimo Zamperini,Ivan Daroui,Walter Mosaner
DOI: https://doi.org/10.1186/s44158-021-00002-x
2021-09-01
Abstract:Background: Since the beginning of coronavirus disease 2019 (COVID-19), the development of predictive models has sparked relevant interest due to the initial lack of knowledge about diagnosis, treatment, and prognosis. The present study aimed at developing a model, through a machine learning approach, to predict intensive care unit (ICU) mortality in COVID-19 patients based on predefined clinical parameters. Results: Observational multicenter cohort study. All COVID-19 adult patients admitted to 25 ICUs belonging to the VENETO ICU network (February 28th 2020-april 4th 2021) were enrolled. Patients admitted to the ICUs before 4th March 2021 were used for model training ("training set"), while patients admitted after the 5th of March 2021 were used for external validation ("test set 1"). A further group of patients ("test set 2"), admitted to the ICU of IRCCS Ca' Granda Ospedale Maggiore Policlinico of Milan, was used for external validation. A SuperLearner machine learning algorithm was applied for model development, and both internal and external validation was performed. Clinical variables available for the model were (i) age, gender, sequential organ failure assessment score, Charlson Comorbidity Index score (not adjusted for age), Palliative Performance Score; (ii) need of invasive mechanical ventilation, non-invasive mechanical ventilation, O2 therapy, vasoactive agents, extracorporeal membrane oxygenation, continuous venous-venous hemofiltration, tracheostomy, re-intubation, prone position during ICU stay; and (iii) re-admission in ICU. One thousand two hundred ninety-three (80%) patients were included in the "training set", while 124 (8%) and 199 (12%) patients were included in the "test set 1" and "test set 2," respectively. Three different predictive models were developed. Each model included different sets of clinical variables. The three models showed similar predictive performances, with a training balanced accuracy that ranged between 0.72 and 0.90, while the cross-validation performance ranged from 0.75 to 0.85. Age was the leading predictor for all the considered models. Conclusions: Our study provides a useful and reliable tool, through a machine learning approach, for predicting ICU mortality in COVID-19 patients. In all the estimated models, age was the variable showing the most important impact on mortality.