Abstract:BACKGROUND:Although machine learning (ML) algorithms have been applied to point-of-care sepsis prognostication, ML has not been used to predict sepsis mortality in an administrative database. Therefore, we examined the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compared it with that of the conventional context knowledge-based logistic regression approach.OBJECTIVE:The aim of this study is to examine the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compare it with that of the conventional context knowledge-based logistic regression approach.METHODS:We examined inpatient admissions for sepsis in the US National Inpatient Sample using hospitalizations in 2010-2013 as the training data set. We developed four ML models to predict in-hospital mortality: logistic regression with least absolute shrinkage and selection operator regularization, random forest, gradient-boosted decision tree, and deep neural network. To estimate their performance, we compared our models with the Super Learner model. Using hospitalizations in 2014 as the testing data set, we examined the models' area under the receiver operating characteristic curve (AUC), confusion matrix results, and net reclassification improvement.RESULTS:Hospitalizations of 923,759 adults were included in the analysis. Compared with the reference logistic regression (AUC: 0.786, 95% CI 0.783-0.788), all ML models showed superior discriminative ability (P<.001), including logistic regression with least absolute shrinkage and selection operator regularization (AUC: 0.878, 95% CI 0.876-0.879), random forest (AUC: 0.878, 95% CI 0.877-0.880), xgboost (AUC: 0.888, 95% CI 0.886-0.889), and neural network (AUC: 0.893, 95% CI 0.891-0.895). All 4 ML models showed higher sensitivity, specificity, positive predictive value, and negative predictive value compared with the reference logistic regression model (P<.001). We obtained similar results from the Super Learner model (AUC: 0.883, 95% CI 0.881-0.885).CONCLUSIONS:ML approaches can improve sensitivity, specificity, positive predictive value, negative predictive value, discrimination, and calibration in predicting in-hospital mortality in patients hospitalized with sepsis in the United States. These models need further validation and could be applied to develop more accurate models to compare risk-standardized mortality rates across hospitals and geographic regions, paving the way for research and policy initiatives studying disparities in sepsis care.

Machine learning approach for the prediction of 30-day mortality in patients with sepsis-associated encephalopathy

Using Machine Learning to Develop and Validate an In-Hospital Mortality Prediction Model for Patients with Suspected Sepsis

Machine learning for the prediction of 1-year mortality in patients with sepsis-associated acute kidney injury

Prediction of All-cause Mortality with Sepsis-associated Encephalopathy in the ICU Based on Interpretable Machine Learning

Machine learning for early prediction of sepsis-associated acute brain injury

Prediction of 30-Day Mortality for ICU Patients with Sepsis-3

Interpretable machine learning model for early prediction of 28-day mortality in ICU patients with sepsis-induced coagulopathy: development and validation

Machine learning-based prediction of in-hospital mortality for critically ill patients with sepsis-associated acute kidney injury

Prediction of sepsis mortality in ICU patients using machine learning methods

Machine learning algorithm to predict mortality in critically ill patients with sepsis-associated acute kidney injury

Machine learning for the prediction of sepsis-related death: a systematic review and meta-analysis

Predicting Sepsis Mortality in a Population-Based National Database: Machine Learning Approach.

Data-Driven Machine Learning Approaches for Predicting In-Hospital Sepsis Mortality

Prediction and risk assessment of sepsis-associated encephalopathy in ICU based on interpretable machine learning

Explainable Machine-Learning Model for Prediction of In-Hospital Mortality in Septic Patients Requiring Intensive Care Unit Readmission

Predicting 30-days mortality for MIMIC-III patients with sepsis-3: a machine learning approach using XGboost

Enhancing predictions with a stacking ensemble model for ICU mortality risk in patients with sepsis-associated encephalopathy

Machine learning-based prognostic model for 30-day mortality prediction in Sepsis-3

Explainable ensemble machine learning model for prediction of 28-day mortality risk in patients with sepsis-associated acute kidney injury

Machine learning models to predict 30-day mortality for critical patients with myocardial infarction: a retrospective analysis from MIMIC-IV database