Abstract:Background: We aimed to develop an early warning system for real-time sepsis prediction in the ICU by machine learning methods, with tools for interpretative analysis of the predictions. In particular, we focus on the deployment of the system in a target medical center with small historical samples. Methods: Light Gradient Boosting Machine (LightGBM) and multilayer perceptron (MLP) were trained on Medical Information Mart for Intensive Care (MIMIC-III) dataset and then finetuned on the private Historical Database of local Ruijin Hospital (HDRJH) using transfer learning technique. The Shapley Additive Explanations (SHAP) analysis was employed to characterize the feature importance in the prediction inference. Ultimately, the performance of the sepsis prediction system was further evaluated in the real-world study in the ICU of the target Ruijin Hospital. Results: The datasets comprised 6891 patients from MIMIC-III, 453 from HDRJH, and 67 from Ruijin real-world data. The area under the receiver operating characteristic curves (AUCs) for LightGBM and MLP models derived from MIMIC-III were 0.98 - 0.98 and 0.95 - 0.96 respectively on MIMIC-III dataset, and, in comparison, 0.82 - 0.86 and 0.84 - 0.87 respectively on HDRJH, from 1 to 5 h preceding. After transfer learning and ensemble learning, the AUCs of the final ensemble model were enhanced to 0.94 - 0.94 on HDRJH and to 0.86 - 0.9 in the real-world study in the ICU of the target Ruijin Hospital. In addition, the SHAP analysis illustrated the importance of age, antibiotics, net balance, and ventilation for sepsis prediction, making the model interpretable. Conclusions: Our machine learning model allows accurate real-time prediction of sepsis within 5-h preceding. Transfer learning can effectively improve the feasibility to deploy the prediction model in the target cohort, and ameliorate the model performance for external validation. SHAP analysis indicates that the role of antibiotic usage and fluid management needs further investigation. We argue that our system and methodology have the potential to improve ICU management by helping medical practitioners identify at-sepsis-risk patients and prepare for timely diagnosis and intervention. Trial registration: NCT05088850 (retrospectively registered).

Developing and evaluating a machine learning based algorithm to predict the need of pediatric intensive care unit transfer for newly hospitalized children

An ensemble boosting model for predicting transfer to the pediatric intensive care unit

Development and validation of a machine learning algorithm for predicting the risk of postpartum depression among pregnant women

Predicting transfers to intensive care in children using CEWT and other early warning systems

Pediatric Severe Sepsis Prediction Using Machine Learning

Predicting Clinical Deterioration in Hospitals

Development of a deep learning model that predicts critical events of pediatric patients admitted to general wards

Using Electronic Health Record Collected Clinical Variables to Predict Medical Intensive Care Unit Mortality

Risk prediction using the National Early Warning Score and the Worthing Physiological Scoring System in patients who were transported to the Intensive Care Unit from the Emergency Department: A cohort study

Personalized Risk Scoring for Critical Care Prognosis using Mixtures of Gaussian Processes

Multicenter validation of a deep-learning-based pediatric early-warning system for prediction of deterioration events

Using machine learning tools to predict outcomes for emergency department intensive care unit patients

Machine learning-based prediction of critical illness in children visiting the emergency department

Machine learning-based prediction of delirium 24 h after pediatric intensive care unit admission in critically ill children:A prospective cohort study

Pediatric Intensive Care Unit Length of Stay Prediction by Machine Learning

The Application of Pediatric Early Warning Score (PEWS) in Emergency Observation Room.

Artificial intelligence algorithm to predict the need for critical care in prehospital emergency medical services

Transferability and interpretability of the sepsis prediction models in the intensive care unit

Applying Artificial Intelligence to Identify Physiomarkers Predicting Severe Sepsis in the PICU*

The development and validation of a novel deep-learning algorithm to predict in-hospital cardiac arrest in ED-ICU (emergency department-based intensive care units): a single center retrospective cohort study

Predicting Cardiac Arrest in Children with Heart Disease: A Novel Machine Learning Algorithm