Abstract:<h3 class="Heading">Purpose</h3><p class="Para">Early clinical recognition of sepsis can be challenging. With the advancement of machine learning, promising real-time models to predict sepsis have emerged. We assessed their performance by carrying out a systematic review and meta-analysis.</p><h3 class="Heading">Methods</h3><p class="Para">A systematic search was performed in PubMed, Embase.com and Scopus. Studies targeting sepsis, severe sepsis or septic shock in any hospital setting were eligible for inclusion. The index test was any supervised machine learning model for real-time prediction of these conditions. Quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology, with a tailored Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist to evaluate risk of bias. Models with a reported area under the curve of the receiver operating characteristic (AUROC) metric were meta-analyzed to identify strongest contributors to model performance.</p><h3 class="Heading">Results</h3><p class="Para">After screening, a total of 28 papers were eligible for synthesis, from which 130 models were extracted. The majority of papers were developed in the intensive care unit (ICU, <em class="EmphasisTypeItalic">n </em>= 15; 54%), followed by hospital wards (<em class="EmphasisTypeItalic">n </em>= 7; 25%), the emergency department (ED, <em class="EmphasisTypeItalic">n </em>= 4; 14%) and all of these settings (<em class="EmphasisTypeItalic">n </em>= 2; 7%). For the prediction of sepsis, diagnostic test accuracy assessed by the AUROC ranged from 0.68–0.99 in the ICU, to 0.96–0.98 in-hospital and 0.87 to 0.97 in the ED. Varying sepsis definitions limit pooling of the performance across studies. Only three papers clinically implemented models with mixed results. In the multivariate analysis, temperature, lab values, and model type contributed most to model performance.</p><h3 class="Heading">Conclusion</h3><p class="Para">This systematic review and meta-analysis show that on retrospective data, individual machine learning models can accurately predict sepsis onset ahead of time. Although they present alternatives to traditional scoring systems, between-study heterogeneity limits the assessment of pooled results. Systematic reporting and clinical implementation studies are needed to bridge the gap between bytes and bedside.</p>

Prediction of candidemia with machine learning techniques: state of the art

A machine learning model for early candidemia prediction in the intensive care unit: Clinical application

Machine-learning Based Prediction and Analysis of Prognostic Risk Factors in Patients with Candidemia and Bacteraemia: a 5-Year Analysis

Machine Learning-based Prediction Models for C difficile Infection: A Systematic Review

Machine learning in the clinical microbiology laboratory: has the time come for routine practice?

Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective

Machine learning in infection management using routine electronic health records: tools, techniques, and reporting of future technologies

Using interpretable machine learning to predict bloodstream infection and antimicrobial resistance in patients admitted to ICU: Early alert predictors based on EHR data to guide antimicrobial stewardship

How is test laboratory data used and characterised by machine learning models? A systematic review of diagnostic and prognostic models developed for COVID-19 patients using only laboratory data

Machine learning approaches in microbiome research: challenges and best practices

Machine learning model for the prediction of gram-positive and gram-negative bacterial bloodstream infection based on routine laboratory parameters

The value of machine learning approaches in the diagnosis of early gastric cancer: a systematic review and meta-analysis

Applications of Machine Learning Predictive Models in the Chronic Disease Diagnosis

Machine Learning Applications in Medical Prognostics: A Comprehensive Review

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy

Using machine learning to predict bacteremia in urgent care patients on the basis of triage data and laboratory results

Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms

A machine learning model for the early diagnosis of bloodstream infection in patients admitted to the pediatric intensive care unit

Machine Learning: A Potential Therapeutic Tool to Facilitate Neonatal Therapeutic Decision Making

A Comparative Analysis of Machine Learning Approaches to Predict C. Difficile Infection in Hospitalized Patients.

Explainable and Interpretable Machine Learning for Antimicrobial Stewardship: Opportunities and Challenges