Abstract:BACKGROUND:Although machine learning (ML) algorithms have been applied to point-of-care sepsis prognostication, ML has not been used to predict sepsis mortality in an administrative database. Therefore, we examined the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compared it with that of the conventional context knowledge-based logistic regression approach.OBJECTIVE:The aim of this study is to examine the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compare it with that of the conventional context knowledge-based logistic regression approach.METHODS:We examined inpatient admissions for sepsis in the US National Inpatient Sample using hospitalizations in 2010-2013 as the training data set. We developed four ML models to predict in-hospital mortality: logistic regression with least absolute shrinkage and selection operator regularization, random forest, gradient-boosted decision tree, and deep neural network. To estimate their performance, we compared our models with the Super Learner model. Using hospitalizations in 2014 as the testing data set, we examined the models' area under the receiver operating characteristic curve (AUC), confusion matrix results, and net reclassification improvement.RESULTS:Hospitalizations of 923,759 adults were included in the analysis. Compared with the reference logistic regression (AUC: 0.786, 95% CI 0.783-0.788), all ML models showed superior discriminative ability (P<.001), including logistic regression with least absolute shrinkage and selection operator regularization (AUC: 0.878, 95% CI 0.876-0.879), random forest (AUC: 0.878, 95% CI 0.877-0.880), xgboost (AUC: 0.888, 95% CI 0.886-0.889), and neural network (AUC: 0.893, 95% CI 0.891-0.895). All 4 ML models showed higher sensitivity, specificity, positive predictive value, and negative predictive value compared with the reference logistic regression model (P<.001). We obtained similar results from the Super Learner model (AUC: 0.883, 95% CI 0.881-0.885).CONCLUSIONS:ML approaches can improve sensitivity, specificity, positive predictive value, negative predictive value, discrimination, and calibration in predicting in-hospital mortality in patients hospitalized with sepsis in the United States. These models need further validation and could be applied to develop more accurate models to compare risk-standardized mortality rates across hospitals and geographic regions, paving the way for research and policy initiatives studying disparities in sepsis care.

Performance of machine learning algorithms for surgical site infection case detection and prediction: A systematic review and meta-analysis

Development of Machine Learning Models for the Surveillance of Colon Surgical Site Infections.

Systematic review and network meta-analysis of machine learning algorithms in sepsis prediction

Application of machine learning algorithms to predict postoperative surgical site infections and surgical site occurrences following inguinal hernia surgery

Risk predictions of surgical wound complications based on a machine learning algorithm: A systematic review

Can machine learning models improve the prediction of surgical site infection in abdominal surgery than traditional statistical models?

Artificial intelligence and machine learning applications in urinary tract infections identification and prediction: a systematic review and meta-analysis

Machine Learning Approaches for the Image-Based Identification of Surgical Wound Infections: Scoping Review

Machine Learning Application for Prediction of Surgical Site Infection after Posterior Cervical Surgery.

Machine learning with interpretability predict surgical site infection after posterior cervical surgery

Artificial Intelligence Methods for Surgical Site Infection: Impacts on Detection, Monitoring, and Decision Making.

Using Preoperative and Intraoperative Factors to Predict the Risk of Surgical Site Infections after Lumbar Spinal Surgery: A Machine Learning-Based Study.

Meta-lasso: new insight on infection prediction after minimally invasive surgery

Development and Internal Validation of Supervised Machine Learning Algorithms for Predicting the Risk of Surgical Site Infection Following Minimally Invasive Transforaminal Lumbar Interbody Fusion Under Quadrant Channel

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy

Development of machine learning models for the detection of surgical site infections following total hip and knee arthroplasty: a multicenter cohort study

-A machine learning model to predict surgical site infection after surgery of lower extremity fractures

The detection and prediction of surgical site infections using multi-modal sensors and machine learning: Results in an animal model

Accuracy of machine learning in predicting outcomes post-percutaneous coronary intervention: a systematic review

Prediction Models for Forecasting Risk of Development of Surgical Site Infection after Lower Limb Revascularization Surgery: A Systematic Review

Predicting Sepsis Mortality in a Population-Based National Database: Machine Learning Approach.