[Splenoportography in primary cancer of the liver].

P. Bovy

Abstract:

What problem does this paper attempt to address?

Prediction of sepsis within 24 hours at the triage stage in emergency departments using machine learning

Jingyuan Xie,Jiandong Gao,Mutian Yang,Ting Zhang,Yecheng Liu,Yutong Chen,Zetong Liu,Qimin Mei,Zhimao Li,Huadong Zhu,Ji Wu

DOI: https://doi.org/10.5847/wjem.j.1920-8642.2024.074

Abstract:Background: Sepsis is one of the main causes of mortality in intensive care units (ICUs). Early prediction is critical for reducing injury. As approximately 36% of sepsis occur within 24 h after emergency department (ED) admission in Medical Information Mart for Intensive Care (MIMIC-IV), a prediction system for the ED triage stage would be helpful. Previous methods such as the quick Sequential Organ Failure Assessment (qSOFA) are more suitable for screening than for prediction in the ED, and we aimed to find a light-weight, convenient prediction method through machine learning. Methods: We accessed the MIMIC-IV for sepsis patient data in the EDs. Our dataset comprised demographic information, vital signs, and synthetic features. Extreme Gradient Boosting (XGBoost) was used to predict the risk of developing sepsis within 24 h after ED admission. Additionally, SHapley Additive exPlanations (SHAP) was employed to provide a comprehensive interpretation of the model's results. Ten percent of the patients were randomly selected as the testing set, while the remaining patients were used for training with 10-fold cross-validation. Results: For 10-fold cross-validation on 14,957 samples, we reached an accuracy of 84.1%±0.3% and an area under the receiver operating characteristic (ROC) curve of 0.92±0.02. The model achieved similar performance on the testing set of 1,662 patients. SHAP values showed that the five most important features were acuity, arrival transportation, age, shock index, and respiratory rate. Conclusion: Machine learning models such as XGBoost may be used for sepsis prediction using only a small amount of data conveniently collected in the ED triage stage. This may help reduce workload in the ED and warn medical workers against the risk of sepsis in advance.
Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation Study

Chang Hu,Lu Li,Weipeng Huang,Tong Wu,Qiancheng Xu,Juan Liu,Bo Hu

DOI: https://doi.org/10.1007/s40121-022-00628-6

2022-04-10

Infectious Diseases and Therapy

Abstract:IntroductionThis study aimed to develop and validate an interpretable machine-learning model based on clinical features for early predicting in-hospital mortality in critically ill patients with sepsis.MethodsWe enrolled all patients with sepsis in the Medical Information Mart for Intensive Care IV (MIMIC-IV, v.1.0) database from 2008 to 2019. Lasso regression was used for feature selection. Seven machine-learning methods were applied to develop the models. The best model was selected based on its accuracy and area under curve (AUC) in the validation cohort. Furthermore, we employed the SHapley Additive exPlanations (SHAP) method to illustrate the effects of the features attributed to the model, and to analyze how the individual features affect the output of the model, and to visualize the Shapley value for a single individual.ResultsIn total, 8,817 patients with sepsis were eligible for participation, the median age was 66.8 years (IQR, 55.9–77.1 years), and 3361 of 8817 participants (38.1%) were women. After selection, 25 of a total 57 clinical parameters collected on day 1 after ICU admission remained associated with prognosis and were used for developing the machine-learning models. Among seven constructed models, the eXtreme Gradient Boosting (XGBoost) model achieved the best performance with an AUC of 0.884 and an accuracy of 89.5% in the validation cohort. Feature importance analysis showed that Glasgow Coma Scale (GCS) score, blood urea nitrogen, respiratory rate, urine output, and age were the top 5 features of the XGBoost model with the greatest impact. Furthermore, SHAP force analysis illustrated how the constructed model visualized the individualized prediction of death.ConclusionsWe have demonstrated the potential of machine-learning approaches for predicting outcome early in patients with sepsis. The SHAP method could improve the interpretability of machine-learning models and help clinicians better understand the reasoning behind the outcome.

infectious diseases
A machine-learning approach for dynamic prediction of sepsis-induced coagulopathy in critically ill patients with sepsis: an integrated analysis of the MIMIC-IV and eICU-CRD databases

Qin-Yu Zhao,Le-Ping Liu,Jing-Chao Luo,Yan-Wei Luo,Huan Wang,Yi-Jie Zhang,Rong Gui,Guo-Wei Tu,Zhe Luo

DOI: https://doi.org/10.21203/rs.3.rs-125438/v1

2020-12-11

Abstract:Abstract Background Sepsis-induced coagulopathy (SIC) denotes an increased mortality rate and poorer prognosis in septic patients. Methods Machine-learning models were developed based on septic patients who were older than 18 years and stayed in intensive care units (ICUs) for more than 24 hours in Medical Information Mart for Intensive Care (MIMIC)-IV. Eighty-eight potential predictors were extracted, and 15 various machine-learning models assessed the daily risk of SIC. The most potent model was selected based on its accuracy and Area Under the receiver operating characteristic Curve (AUC), followed by fine-grained hyperparameter adjustment using the Bayesian Optimization Algorithm. The effects of features on prediction scores were measured using the SHapley Additive exPlanations (SHAP) values. A compact model was developed, based on 15 features selected according to their importance and clinical availability. Two models were compared with Logistic Regression and SIC scores in terms of SIC prediction. Additionally, an external validation was performed in the eICU Collaborative Research Database (eICU-CRD). Results Of 11362 patients in MIMIC-IV included in the final cohort, a total of 6744 (59%) patients had SIC during sepsis, and 16183 samples were extracted. The model named Categorical Boosting (CatBoost) had the greatest AUC in our study (0.869 [0.850, 0.886]). Coagulation profile and renal function indicators are the most important features to predict SIC. A compact model was developed with the AUC of 0.854 [0.832, 0.872], while the AUCs of Logistic Regression and SIC scores were 0.746 [0.735, 0.755] and 0.709 [0.687, 0.733], respectively. A cohort of 35252 septic patients in eICU-CRD was analyzed. The AUCs of the full and the compact models in external validation were 0.842 [0.837, 0.846] and 0.803 [0.798, 0.809], respectively, which were still larger than those of Logistic Regression (0.660 [0.653, 0.667]) and SIC scores (0.752 [0.747, 0.757]). Prediction results can be illustrated by using SHAP values in the instance level, which makes our models clinically interpretable. Conclusions We developed two models which were able to dynamically predict the risk of SIC in septic patients better than conventional Logistic Regression and SIC scores. Prediction results of our two models can be interpreted by using SHAP values.
Early Prediction of Mortality, Severity, and Length of Stay in the Intensive Care Unit of Sepsis Patients Based on Sepsis 3.0 by Machine Learning Models

Longxiang Su,Zheng Xu,Fengxiang Chang,Yingying Ma,Shengjun Liu,Huizhen Jiang,Hao Wang,Dongkai Li,Huan Chen,Xiang Zhou,Na Hong,Weiguo Zhu,Yun Long

DOI: https://doi.org/10.3389/fmed.2021.664966

IF: 3.9

2021-06-28

Frontiers in Medicine

Abstract:Background: Early prediction of the clinical outcome of patients with sepsis is of great significance and can guide treatment and reduce the mortality of patients. However, it is clinically difficult for clinicians. Methods: A total of 2,224 patients with sepsis were involved over a 3-year period (2016–2018) in the intensive care unit (ICU) of Peking Union Medical College Hospital. With all the key medical data from the first 6 h in the ICU, three machine learning models, logistic regression, random forest, and XGBoost, were used to predict mortality, severity (sepsis/septic shock), and length of ICU stay (LOS) (>6 days, ≤ 6 days). Missing data imputation and oversampling were completed on the dataset before introduction into the models. Results: Compared to the mortality and LOS predictions, the severity prediction achieved the best classification results, based on the area under the operating receiver characteristics (AUC), with the random forest classifier (sensitivity = 0.65, specificity = 0.73, F1 score = 0.72, AUC = 0.79). The random forest model also showed the best overall performance (mortality prediction: sensitivity = 0.50, specificity = 0.84, F1 score = 0.66, AUC = 0.74; LOS prediction: sensitivity = 0.79, specificity = 0.66, F1 score = 0.69, AUC = 0.76) among the three models. The predictive ability of the SOFA score itself was inferior to that of the above three models. Conclusions: Using the random forest classifier in the first 6 h of ICU admission can provide a comprehensive early warning of sepsis, which will contribute to the formulation and management of clinical decisions and the allocation and management of resources.

medicine, general & internal
Prediction of Sepsis Mortality in ICU Patients Using Machine Learning Methods

Jiayi Gao,Yuying Lu,Negin Ashrafi,Ian Raymond Domingo,Kamiar Alaei,Maryam Pishgar

DOI: https://doi.org/10.1101/2024.03.14.24304184

2024-06-26

Abstract:Problem: Sepsis, a life-threatening condition, accounts for the deaths of millions of people worldwide. Accurate prediction of sepsis outcomes is crucial for effective treatment and management. Previous studies have utilized machine learning for prognosis but have limitations in feature sets and model interpretability. Aim: This study aims to develop a machine learning model that enhances prediction accuracy for sepsis outcomes using a reduced set of features, thereby addressing the limitations of previous studies and enhancing model interpretability. Methods: This study analyzes intensive care patient outcomes using the MIMIC-IV database, focusing on adult sepsis cases. Employing the latest data extraction tools, such as Google BigQuery, and following stringent selection criteria, we selected 38 features in this study. This selection is also informed by a comprehensive literature review and clinical expertise. Data preprocessing included handling missing values, regrouping categorical variables, and using the Synthetic Minority Over-sampling Technique (SMOTE) to balance the data. We evaluated several machine learning models: Decision Trees, Gradient Boosting, XGBoost, LightGBM, Multilayer Perceptrons (MLP), Support Vector Machines (SVM), and Random Forest. The Sequential Halving and Classification (SHAC) algorithm was used for hyperparameter tuning, and both train-test split and cross-validation methodologies were employed for performance and computational efficiency. Results: The Random Forest model was the most effective, achieving an area under the receiver operating characteristic curve (AUROC) of 0.94 with a confidence interval of 0.93 to 0.95. This significantly outperformed other models and set a new benchmark in the literature. The model also provided detailed insights into the importance of various clinical features, with the Sequential Organ Failure Assessment (SOFA) score and average urine output being highly predictive. SHAP (Shapley Additive Explanations) analysis further enhanced the model's interpretability, offering a clearer understanding of feature impacts. Conclusion: This study demonstrates significant improvements in predicting sepsis outcomes using a Random Forest model, supported by advanced machine learning techniques and thorough data preprocessing. Our approach provided detailed insights into the key clinical features impacting sepsis mortality, making the model both highly accurate and interpretable. By enhancing the model's practical utility in clinical settings, we offer a valuable tool for healthcare professionals to make data-driven decisions, ultimately aiming to minimize sepsis-induced fatalities.

Health Informatics
An early sepsis prediction model utilizing machine learning and unbalanced data processing in a clinical context

Luyao Zhou,Min Shao,Cui Wang,Yu Wang

DOI: https://doi.org/10.1016/j.pmedr.2024.102841

2024-08-02

Abstract:Background: Early and accurate diagnoses of sepsis patients are essential to reduce the mortality. However, the sepsis is still diagnosed in a traditional way in China despite the increasing number of related studies, which may to some extent lead to delays in the treatment. Methods: The study included 2,385 patients, including 364 with sepsis, collected from the First Affiliated Hospital of Anhui Medical University and partner hospitals from April to July 2022. External validation was conducted using the MIMIC-III database (over 60,000 patients from 2001 to 2012) and the eICU Collaborative Research Database (139,000 patients from 2014 to 2015). Multiple algorithm models, along with the SHapley Additive exPlanations (SHAP) analysis, are applied to explore the main risk factors for the accurate prediction of the sepsis. Multiple Imputations for filling missing data and the Synthetic Minority Oversampling (SMOTE) balancing method for balancing data are used for the data processing. Result: Eighteen diagnostic features are used in the predictive model for early sepsis. The Random Forest model has the best performance among all the models, with an Area Under the Curve (AUC) of 87% and an F1-score (F1) of 77%. Moreover, the interpretation from the SHAP analysis is generally consistent with the current clinical situation. Conclusion: The study revealed the relationship between these 18 clinical features and diagnostic outcomes. The results indicate that patients with laboratory values of Systolic Blood Pressure, Albumin, and Heart Rate exceeding certain thresholds are at a high likelihood of developing sepsis.
Early sepsis mortality prediction model based on interpretable machine learning approach: development and validation study

Yiping Wang,Zhihong Gao,Yang Zhang,Zhongqiu Lu,Fangyuan Sun

DOI: https://doi.org/10.1007/s11739-024-03732-2

2024-08-14

Abstract:Sepsis triggers a harmful immune response due to infection, causing high mortality. Predicting sepsis outcomes early is vital. Despite machine learning's (ML) use in medical research, local validation within the Medical Information Mart for Intensive Care IV (MIMIC-IV) database is lacking. We aimed to devise a prognostic model, leveraging MIMIC-IV data, to predict sepsis mortality and validate it in a Chinese teaching hospital. MIMIC-IV provided patient data, split into training and internal validation sets. Four ML models logistic regression (LR), support vector machine (SVM), deep neural networks (DNN), and extreme gradient boosting (XGBoost) were employed. Shapley additive interpretation offered early and interpretable mortality predictions. Area under the ROC curve (AUROC) gaged predictive performance. Results were cross verified in a Chinese teaching hospital. The study included 27,134 sepsis patients from MIMIC-IV and 487 from China. After comparing, 52 clinical indicators were selected for ML model development. All models exhibited excellent discriminative ability. XGBoost surpassed others, with AUROC of 0.873 internally and 0.844 externally. XGBoost outperformed other ML models (LR: 0.829; SVM: 0.830; DNN: 0.837) and clinical scores (Simplified Acute Physiology Score II: 0.728; Sequential Organ Failure Assessment: 0.728; Oxford Acute Severity of Illness Score: 0.738; Glasgow Coma Scale: 0.691). XGBoost's hospital mortality prediction achieved AUROC 0.873, sensitivity 0.818, accuracy 0.777, specificity 0.768, and F1 score 0.551. We crafted an interpretable model for sepsis death risk prediction. ML algorithms surpassed traditional scores for sepsis mortality forecast. Validation in a Chinese teaching hospital echoed these findings.
A Machine-Learning Approach for Dynamic Prediction of Sepsis-Induced Coagulopathy in Critically Ill Patients With Sepsis

Qin-Yu Zhao,Le-Ping Liu,Jing-Chao Luo,Yan-Wei Luo,Huan Wang,Yi-Jie Zhang,Rong Gui,Guo-Wei Tu,Zhe Luo

DOI: https://doi.org/10.3389/fmed.2020.637434

IF: 3.9

2021-01-21

Frontiers in Medicine

Abstract:Background: Sepsis-induced coagulopathy (SIC) denotes an increased mortality rate and poorer prognosis in septic patients. Objectives: Our study aimed to develop and validate machine-learning models to dynamically predict the risk of SIC in critically ill patients with sepsis. Methods: Machine-learning models were developed and validated based on two public databases named Medical Information Mart for Intensive Care (MIMIC)-IV and the eICU Collaborative Research Database (eICU-CRD). Dynamic prediction of SIC involved an evaluation of the risk of SIC each day after the diagnosis of sepsis using 15 predictive models. The best model was selected based on its accuracy and area under the receiver operating characteristic curve (AUC), followed by fine-grained hyperparameter adjustment using the Bayesian Optimization Algorithm. A compact model was developed, based on 15 features selected according to their importance and clinical availability. These two models were compared with Logistic Regression and SIC scores in terms of SIC prediction. Results: Of 11,362 patients in MIMIC-IV included in the final cohort, a total of 6,744 (59%) patients developed SIC during sepsis. The model named Categorical Boosting (CatBoost) had the greatest AUC in our study (0.869; 95% CI: 0.850–0.886). Coagulation profile and renal function indicators were the most important features for predicting SIC. A compact model was developed with an AUC of 0.854 (95% CI: 0.832–0.872), while the AUCs of Logistic Regression and SIC scores were 0.746 (95% CI: 0.735–0.755) and 0.709 (95% CI: 0.687–0.733), respectively. A cohort of 35,252 septic patients in eICU-CRD was analyzed. The AUCs of the full and the compact models in the external validation were 0.842 (95% CI: 0.837–0.846) and 0.803 (95% CI: 0.798–0.809), respectively, which were still larger than those of Logistic Regression (0.660; 95% CI: 0.653–0.667) and SIC scores (0.752; 95% CI: 0.747–0.757). Prediction results were illustrated by SHapley Additive exPlanations (SHAP) values, which made our models clinically interpretable. Conclusions: We developed two models which were able to dynamically predict the risk of SIC in septic patients better than conventional Logistic Regression and SIC scores.

medicine, general & internal
Predicting sepsis using deep learning across international sites: a retrospective development and validation study

Michael Moor,Nicolas Bennett,Drago Plečko,Max Horn,Bastian Rieck,Nicolai Meinshausen,Peter Bühlmann,Karsten Borgwardt

DOI: https://doi.org/10.1016/j.eclinm.2023.102124

IF: 15.1

2023-08-11

EClinicalMedicine

Abstract:Background: When sepsis is detected, organ damage may have progressed to irreversible stages, leading to poor prognosis. The use of machine learning for predicting sepsis early has shown promise, however international validations are missing. Methods: This was a retrospective, observational, multi-centre cohort study. We developed and externally validated a deep learning system for the prediction of sepsis in the intensive care unit (ICU). Our analysis represents the first international, multi-centre in-ICU cohort study for sepsis prediction using deep learning to our knowledge. Our dataset contains 136,478 unique ICU admissions, representing a refined and harmonised subset of four large ICU databases comprising data collected from ICUs in the US, the Netherlands, and Switzerland between 2001 and 2016. Using the international consensus definition Sepsis-3, we derived hourly-resolved sepsis annotations, amounting to 25,694 (18.8%) patient stays with sepsis. We compared our approach to clinical baselines as well as machine learning baselines and performed an extensive internal and external statistical validation within and across databases, reporting area under the receiver-operating-characteristic curve (AUC). Findings: Averaged over sites, our model was able to predict sepsis with an AUC of 0.846 (95% confidence interval [CI], 0.841-0.852) on a held-out validation cohort internal to each site, and an AUC of 0.761 (95% CI, 0.746-0.770) when validating externally across sites. Given access to a small fine-tuning set (10% per site), the transfer to target sites was improved to an AUC of 0.807 (95% CI, 0.801-0.813). Our model raised 1.4 false alerts per true alert and detected 80% of the septic patients 3.7 h (95% CI, 3.0-4.3) prior to the onset of sepsis, opening a vital window for intervention. Interpretation: By monitoring clinical and laboratory measurements in a retrospective simulation of a real-time prediction scenario, a deep learning system for the detection of sepsis generalised to previously unseen ICU cohorts, internationally. Funding: This study was funded by the Personalized Health and Related Technologies (PHRT) strategic focus area of the ETH domain.
Using machine learning methods to predict in-hospital mortality of sepsis patients in the ICU

Guilan Kong,Ke Lin,Yonghua Hu

DOI: https://doi.org/10.1186/s12911-020-01271-2

IF: 3.298

2020-01-01

BMC Medical Informatics and Decision Making

Abstract:Background Early and accurate identification of sepsis patients with high risk of in-hospital death can help physicians in intensive care units (ICUs) make optimal clinical decisions. This study aimed to develop machine learning-based tools to predict the risk of hospital death of patients with sepsis in ICUs. Methods The source database used for model development and validation is the medical information mart for intensive care (MIMIC) III. We identified adult sepsis patients using the new sepsis definition Sepsis-3. A total of 86 predictor variables consisting of demographics, laboratory tests and comorbidities were used. We employed the least absolute shrinkage and selection operator (LASSO), random forest (RF), gradient boosting machine (GBM) and the traditional logistic regression (LR) method to develop prediction models. In addition, the prediction performance of the four developed models was evaluated and compared with that of an existent scoring tool – simplified acute physiology score (SAPS) II – using five different performance measures: the area under the receiver operating characteristic curve (AUROC), Brier score, sensitivity, specificity and calibration plot. Results The records of 16,688 sepsis patients in MIMIC III were used for model training and test. Amongst them, 2949 (17.7%) patients had in-hospital death. The average AUROCs of the LASSO, RF, GBM, LR and SAPS II models were 0.829, 0.829, 0.845, 0.833 and 0.77, respectively. The Brier scores of the LASSO, RF, GBM, LR and SAPS II models were 0.108, 0.109, 0.104, 0.107 and 0.146, respectively. The calibration plots showed that the GBM, LASSO and LR models had good calibration; the RF model underestimated high-risk patients; and SAPS II had the poorest calibration. Conclusion The machine learning-based models developed in this study had good prediction performance. Amongst them, the GBM model showed the best performance in predicting the risk of in-hospital death. It has the potential to assist physicians in the ICU to perform appropriate clinical interventions for critically ill sepsis patients and thus may help improve the prognoses of sepsis patients in the ICU.
A Machine Learning Model for Accurate Prediction of Sepsis in ICU Patients

Dong Wang,Jinbo Li,Yali Sun,Xianfei Ding,Xiaojuan Zhang,Shaohua Liu,Bing Han,Haixu Wang,Xiaoguang Duan,Tongwen Sun

DOI: https://doi.org/10.3389/fpubh.2021.754348

IF: 5.2

2021-10-15

Frontiers in Public Health

Abstract:Background: Although numerous studies are conducted every year on how to reduce the fatality rate associated with sepsis, it is still a major challenge faced by patients, clinicians, and medical systems worldwide. Early identification and prediction of patients at risk of sepsis and adverse outcomes associated with sepsis are critical. We aimed to develop an artificial intelligence algorithm that can predict sepsis early. Methods: This was a secondary analysis of an observational cohort study from the Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University. A total of 4,449 infected patients were randomly assigned to the development and validation data set at a ratio of 4:1. After extracting electronic medical record data, a set of 55 features (variables) was calculated and passed to the random forest algorithm to predict the onset of sepsis. Results: The pre-procedure clinical variables were used to build a prediction model from the training data set using the random forest machine learning method; a 5-fold cross-validation was used to evaluate the prediction accuracy of the model. Finally, we tested the model using the validation data set. The area obtained by the model under the receiver operating characteristic (ROC) curve (AUC) was 0.91, the sensitivity was 87%, and the specificity was 89%. Conclusions: This newly established machine learning-based model has shown good predictive ability in Chinese sepsis patients. External validation studies are necessary to confirm the universality of our method in the population and treatment practice.

public, environmental & occupational health
An Interpretable Machine Learning Model for Accurate Prediction of Sepsis in the ICU

Shamim Nemati,Andre Holder,Fereshteh Razmi,Matthew D Stanley,Gari D Clifford,Timothy G Buchman,Holder, Andre,Razmi, Fereshteh,Clifford, Gari D.,Nemati, Shamim,Buchman, Timothy G.,Stanley, Matthew D.

DOI: https://doi.org/10.1097/CCM.0000000000002936

IF: 8.8

2019-10-03

Critical Care Medicine

Abstract:Objectives: Sepsis is among the leading causes of morbidity, mortality, and cost overruns in critically ill patients. Early intervention with antibiotics improves survival in septic patients. However, no clinically validated system exists for real-time prediction of sepsis onset. We aimed to develop and validate an Artificial Intelligence Sepsis Expert algorithm for early prediction of sepsis. Design: Observational cohort study. Setting: Academic medical center from January 2013 to December 2015. Patients: Over 31,000 admissions to the ICUs at two Emory University hospitals (development cohort), in addition to over 52,000 ICU patients from the publicly available Medical Information Mart for Intensive Care-III ICU database (validation cohort). Patients who met the Third International Consensus Definitions for Sepsis (Sepsis-3) prior to or within 4 hours of their ICU admission were excluded, resulting in roughly 27,000 and 42,000 patients within our development and validation cohorts, respectively. Interventions: None. Measurements and Main Results: High-resolution vital signs time series and electronic medical record data were extracted. A set of 65 features (variables) were calculated on hourly basis and passed to the Artificial Intelligence Sepsis Expert algorithm to predict onset of sepsis in the proceeding T hours (where T = 12, 8, 6, or 4). Artificial Intelligence Sepsis Expert was used to predict onset of sepsis in the proceeding T hours and to produce a list of the most significant contributing factors. For the 12-, 8-, 6-, and 4-hour ahead prediction of sepsis, Artificial Intelligence Sepsis Expert achieved area under the receiver operating characteristic in the range of 0.83–0.85. Performance of the Artificial Intelligence Sepsis Expert on the development and validation cohorts was indistinguishable. Conclusions: Using data available in the ICU in real-time, Artificial Intelligence Sepsis Expert can accurately predict the onset of sepsis in an ICU patient 4–12 hours prior to clinical recognition. A prospective study is necessary to determine the clinical utility of the proposed sepsis prediction model.

critical care medicine
Multicentre Validation of a Sepsis Prediction Algorithm Using Only Vital Sign Data in the Emergency Department, General Ward and ICU

Qingqing Mao,Melissa Jay,Jana L. Hoffman,Jacob Calvert,Christopher Barton,David Shimabukuro,Lisa Shieh,Uli Chettipally,Grant Fletcher,Yaniv Kerem,Yifan Zhou,Ritankar Das

DOI: https://doi.org/10.1136/bmjopen-2017-017833

IF: 3.006

2018-01-01

BMJ Open

Abstract:OBJECTIVES:We validate a machine learning-based sepsis-prediction algorithm (InSight) for the detection and prediction of three sepsis-related gold standards, using only six vital signs. We evaluate robustness to missing data, customisation to site-specific data using transfer learning and generalisability to new settings.DESIGN:A machine-learning algorithm with gradient tree boosting. Features for prediction were created from combinations of six vital sign measurements and their changes over time.SETTING:A mixed-ward retrospective dataset from the University of California, San Francisco (UCSF) Medical Center (San Francisco, California, USA) as the primary source, an intensive care unit dataset from the Beth Israel Deaconess Medical Center (Boston, Massachusetts, USA) as a transfer-learning source and four additional institutions' datasets to evaluate generalisability.PARTICIPANTS:684 443 total encounters, with 90 353 encounters from June 2011 to March 2016 at UCSF.INTERVENTIONS:None.PRIMARY AND SECONDARY OUTCOME MEASURES:Area under the receiver operating characteristic (AUROC) curve for detection and prediction of sepsis, severe sepsis and septic shock.RESULTS:For detection of sepsis and severe sepsis, InSight achieves an AUROC curve of 0.92 (95% CI 0.90 to 0.93) and 0.87 (95% CI 0.86 to 0.88), respectively. Four hours before onset, InSight predicts septic shock with an AUROC of 0.96 (95% CI 0.94 to 0.98) and severe sepsis with an AUROC of 0.85 (95% CI 0.79 to 0.91).CONCLUSIONS:InSight outperforms existing sepsis scoring systems in identifying and predicting sepsis, severe sepsis and septic shock. This is the first sepsis screening system to exceed an AUROC of 0.90 using only vital sign inputs. InSight is robust to missing data, can be customised to novel hospital data using a small fraction of site data and retains strong discrimination across all institutions.
Interpretable Machine Learning to Optimize Early In-Hospital Mortality Prediction for Elderly Patients with Sepsis: A Discovery Study

Xiaowei Ke,Fangjie Zhang,Guoqing Huang,Aimin Wang

DOI: https://doi.org/10.1155/2022/4820464

IF: 2.809

2022-12-17

Computational and Mathematical Methods in Medicine

Abstract:Sepsis-related mortality rates are high among elderly patients, especially those in intensive care units (ICUs). Early prediction of the prognosis of sepsis is critical, as prompt and effective treatment can improve prognosis. Researchers have predicted mortality and the development of sepsis using machine learning algorithms; however, few studies specifically focus on elderly patients with sepsis. This paper proposes a viable model for early prediction of in-hospital mortality among elderly patients diagnosed with sepsis. We extracted patient information from the Medical Information Mart for Intensive Care IV database. We employed several machine learning algorithms to predict the in-hospital mortality of elderly ICU patients with sepsis. The performance of the model was evaluated by using the AUROC and F 1 score. Furthermore, the SHAP algorithm was used to explain the model, analyze how the individual features affect the model output, and visualize the Shapley value for a single individual. Our study included 18522 elderly patients, with a mortality of 15.4%. After screening, 59 clinical variables were extracted to develop models. Feature importance analysis showed that age, PO2, RDW, SPO2, WBC, and urine output were significantly related to the in-hospital mortality. According to the results of AUROC (0.871 (95% CI: 0.854–0.888)) and F 1 score (0.547 (95% CI: 0.539–0.661)) analyses, the extreme gradient boosting (XGBoost) model outperformed the other models (i.e., LGBM, LR, RF, DT, and KNN). Furthermore, SHAP force analysis illustrated how the constructed model visualized the individualized prediction of death. XGBoost machine learning framework gives good in-hospital mortality prediction of elderly patients with sepsis and can maximize prediction model accuracy. The XGBoost model could be an effective tool to assist doctors in identifying high-risk cases of in-hospital mortality among elderly patients with sepsis. This could be used to create a clinical decision support system in the future.

mathematical & computational biology
A Customised Down-sampling Machine Learning Approach for Sepsis Prediction

Qinhao Wu,Fei Ye,Qianqian Gu,Feng Shao,Xi Long,Zhuozhao Zhan,Junjie Zhang,Jun He,Yangzhou Zhang,Quan Xiao

DOI: https://doi.org/10.1016/j.ijmedinf.2024.105365

IF: 4.73

2024-02-07

International Journal of Medical Informatics

Abstract:Objective Sepsis is a life-threatening condition in the ICU and requires treatment in time. Despite the accuracy of existing sepsis prediction models, insufficient focus on reducing alarms could worsen alarm fatigue and desensitisation in ICUs, potentially compromising patient safety. In this retrospective study, we aim to develop an accurate, robust, and readily deployable method in ICUs, only based on the vital signs and laboratory tests. Methods Our method consists of a customised down-sampling process and a specific dynamic sliding window and XGBoost to offer sepsis prediction. The down-sampling process was applied to the retrospective data for training the XGBoost model. During the testing stage, the dynamic sliding window and the trained XGBoost were used to predict sepsis on the retrospective datasets, PhysioNet and FHC. Results With the filtered data from PhysioNet, our method achieved 80.74% accuracy (77.90% sensitivity and 84.42% specificity) and 83.95% (84.82% sensitivity and 82.00% specificity) on the test set of PhysioNet-A and PhysioNet-B, respectively. The AUC score was 0.89 for both datasets. On the FHC dataset, our method achieved 92.38% accuracy (88.37% sensitivity and 95.16% specificity) and 0.98 AUC score on the test set of FHC. Conclusion Our results indicate that the down-sampling process and the dynamic sliding window with XGBoost brought robust and accurate performance to give sepsis prediction under various hospital settings. The localisation and robustness of our method can assist in sepsis diagnosis in different ICU settings.

health care sciences & services,computer science, information systems,medical informatics
An interpretable machine learning model for real-time sepsis prediction based on basic physiological indicators

T-Y Zhang,M Zhong,Y-Z Cheng,M-W Zhang

DOI: https://doi.org/10.26355/eurrev_202305_32439

Abstract:Objective: In view of the important role of risk prediction models in the clinical diagnosis and treatment of sepsis, and the limitations of existing models in terms of timeliness and interpretability, we intend to develop a real-time prediction model of sepsis with high timeliness and clinical interpretability. Patients and methods: We used eight real-time basic physiological monitoring indicators of patients, including heart rate, respiratory rate, oxygen saturation, mean arterial pressure, systolic blood pressure, diastolic blood pressure, temperature and blood glucose, extracted three-hour dynamic feature sequences, and calculated 3 linear parameters (mean, standard deviation, and endpoint value), a 24-dimensional feature vector was constructed, and finally a real-time sepsis prediction model was constructed based on the Local Interpretable Model-Agnostic Explanation (LIME) interpretability method. Results: The area under the receiver operating characteristic curve (AUROC), Accuracy and F1 scores of Extremely Randomized Trees we built were higher than those of other models, with AUROC above 0.76, showing the best performance. The Imbalance XGBoost has a high specificity (0.86) in predicting sepsis. The LIME local interpretable model we built can display a large amount of valid model prediction details for clinical workers' reference, including the prediction probability and the influence of each feature on the prediction result, thus effectively assisting the work of clinical workers and improving diagnostic efficiency. Conclusions: This model can provide real-time dynamic early warning of sepsis for critically ill patients under supervision and provide a reference for clinical decision support. At the same time, interpretive analysis of sepsis prediction models can improve the credibility of the models.
Real-Time Prediction of Sepsis in Critical Trauma Patients: Machine Learning–Based Modeling Study

Jiang Li,Fengchan Xi,Wenkui Yu,Chuanrui Sun,Xiling Wang

DOI: https://doi.org/10.2196/42452

2023-04-01

JMIR Formative Research

Abstract:Background: Sepsis is a leading cause of death in patients with trauma, and the risk of mortality increases significantly for each hour of delay in treatment. A hypermetabolic baseline and explosive inflammatory immune response mask clinical signs and symptoms of sepsis in trauma patients, making early diagnosis of sepsis more challenging. Machine learning–based predictive modeling has shown great promise in evaluating and predicting sepsis risk in the general intensive care unit (ICU) setting, but there has been no sepsis prediction model specifically developed for trauma patients so far. Objective: To develop a machine learning model to predict the risk of sepsis at an hourly scale among ICU-admitted trauma patients. Methods: We extracted data from adult trauma patients admitted to the ICU at Beth Israel Deaconess Medical Center between 2008 and 2019. A total of 42 raw variables were collected, including demographics, vital signs, arterial blood gas, and laboratory tests. We further derived a total of 485 features, including measurement pattern features, scoring features, and time-series variables, from the raw variables by feature engineering. The data set was randomly split into 70% for model development with stratified 5-fold cross-validation, 15% for calibration, and 15% for testing. An Extreme Gradient Boosting (XGBoost) model was developed to predict the hourly risk of sepsis at prediction windows of 4, 6, 8, 12, and 24 hours. We evaluated model performance for discrimination and calibration both at time-step and outcome levels. Clinical applicability of the model was evaluated with varying levels of precision, and the potential clinical net benefit was assessed with decision curve analysis (DCA). A Shapley additive explanation algorithm was applied to show the effect of features on the prediction model. In addition, we trained an L2-regularized logistic regression model to compare its performance with XGBoost. Results: We included 4603 trauma patients in the study, 1196 (26%) of whom developed sepsis. The XGBoost model achieved an area under the receiver operating characteristics curve (AUROC) ranging from 0.83 to 0.88 at the 4-to-24-hour prediction window in the test set. With a ratio of 9 false alerts for every true alert, it predicted 73% (386/529) of sepsis-positive timesteps and 91% (163/179) of sepsis events in the subsequent 6 hours. The DCA showed our model had a positive net benefit in the threshold probability range of 0 to 0.6. In comparison, the logistic regression model achieved lower performance, with AUROC ranging from 0.76 to 0.84 at the 4-to-24-hour prediction window. Conclusions: The machine learning–based model had good discrimination and calibration performance for sepsis prediction in critical trauma patients. Using the model in clinical practice might help to identify patients at risk of sepsis in a time window that enables personalized intervention and early treatment.
SEPRES: Sepsis prediction via the clinical data integration system in the ICU

Qiyu Chen,Ranran Li,ChihChe Lin,Chiming Lai,Yaling Huang,Wenlian Lu,Lei Li

DOI: https://doi.org/10.1101/2022.07.06.22277188

2022-01-01

Abstract:Background The lack of information interoperability between different devices and systems in the ICU hinders further utilization of data, especially for early warning of specific diseases in the ICU. Objectives We aimed to establish a real-time early warning system for sepsis based on a data integration system that can be implemented at the bedside of the intensive care unit (ICU), named SEPRES. Methods Data is collected from bedside devices through the integration hub and uploaded to the integration system through the local area network. The data integration system was designed to integrate vital signs data, laboratory data, ventilator data, demographic data, pharmacy data, nursing data, etc. from multiple medical devices and systems. It integrates, standardizes, and stores information, making the real-time inference of the early warning module possible. The built-in sepsis early warning module can detect the onset of sepsis within 5 hours preceding at most. Results Our data integration system has already been deployed in Ruijin Hospital, confirming the effectiveness of our system. Conclusions We highlight that SEPRES has the potential to improve ICU management by helping medical practitioners identify at-sepsis-risk patients and prepare for timely diagnosis and intervention. ### Competing Interest Statement The authors have declared no competing interest. ### Funding Statement W.L. received funding from Shanghai Municipal Science and Technology Major Project (2018SHZDZX01), the ZHANGJIANG LAB, and the Science and Technology Commission of Shanghai Municipality (19JC1420101). The funders of the study had no role in the study design, data collection, data analysis, data interpretation, or writing of the report. ### Author Declarations I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained. Yes The details of the IRB/oversight body that provided approval or exemption for the research described are given below: The Ruijin Hospital Ethics Committee gave ethical approval for this work (No. 2020 [140]). I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals. Yes I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance). Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable. Yes All data produced in the present work are contained in the manuscript
Prediction and risk assessment of sepsis-associated encephalopathy in ICU based on interpretable machine learning

Xiao Lu,Hongyu Kang,Dawei Zhou,Qin Li

DOI: https://doi.org/10.1038/s41598-022-27134-6

IF: 4.6

2023-01-01

Scientific Reports

Abstract:Sepsis-associated encephalopathy (SAE) is a major complication of sepsis and is associated with high mortality and poor long-term prognosis. The purpose of this study is to develop interpretable machine learning models to predict the occurrence of SAE after ICU admission and implement the individual prediction and analysis. Patients with sepsis admitted to ICU were included. SAE was diagnosed as glasgow coma score (GCS) less than 15. Statistical analysis at baseline was performed between SAE and non-SAE. Six machine learning classifiers were employed to predict the occurrence of SAE, and the adjustment of model super parameters was performed by using Bayesian optimization method. Finally, the optimal algorithm was selected according to the prediction efficiency. In addition, professional physicians were invited to evaluate our model prediction results for further quantitative assessment of the model interpretability. The preliminary analysis of variance showed significant differences in the incidence of SAE among patients with pathogen infection. There were significant differences in physical indicators like respiratory rate, temperature, SpO 2 and mean arterial pressure ( P < 0.001). In addition, the laboratory results were also significantly different. The optimal classification model (XGBoost) indicated that the best risk factors (cut-off points) were creatinine (1.1 mg/dl), mean respiratory rate (18), pH (7.38), age (72), chlorine (101 mmol/L), sodium (138.5 k/ul), SAPSII score (23), platelet count (160), and phosphorus (2.4 and 5.0 mg/dL). The ranked features derived from the best model (AUC is 0.8837) were mechanical ventilation, duration of mechanical ventilation, phosphorus, SOFA score, and vasopressin usage. The SAE risk prediction model based on XGBoost created here can make very accurate predictions using simple indicators and support the visual explanation. The interpretable model was effectively evaluated by professional physicians and can help them predict the occurrence of SAE more intuitively.

multidisciplinary sciences
A knowledge-transfer-based approach for combining ordinal regression and medical scoring system in the early prediction of sepsis with electronic health records

Yu Ji,Kaipeng Wang,Yuan Yuan,Yueguo Wang,Qingyuan Liu,Yulan Wang,Jian Sun,Wenwen Wang,Huanli Wang,Shusheng Zhou,Kui Jin,Mengping Zhang,Yinglei Lai

DOI: https://doi.org/10.1016/j.compbiolchem.2024.108203

2024-09-02

Abstract:Objective: The prediction of sepsis, especially early diagnosis, has received a significant attention in biomedical research. In order to improve current medical scoring system and overcome the limitations of class imbalance and sample size of local EHR (electronic health records), we propose a novel knowledge-transfer-based approach, which combines a medical scoring system and an ordinal logistic regression model. Materials and methods: Medical scoring systems (i.e. NEWS, SIRS and QSOFA) are generally robust and useful for sepsis diagnosis. With local EHR, machine-learning-based methods have been widely used for building prediction models/methods, but they are often impacted by class imbalance and sample size. Knowledge distillation and knowledge transfer have recently been proposed as a combination approach for improving the prediction performance and model generalization. In this study, we developed a novel knowledge-transfer-based method for combining a medical scoring system (after a proposed score transformation) and an ordinal logistic regression model. We mathematically confirmed that it was equivalent to a specific form of the weighted regression. Furthermore, we theoretically explored its effectiveness in the scenario of class imbalance. Results: For the local dataset and the MIMIC-IV dataset, the VUS (the volume under the multi-dimensional ROC surface, a generalization measure of AUC-ROC for ordinal categories) of the knowledge-transfer-based model (ORNEWS) based on the NEWS scoring system were 0.384 and 0.339, respectively, while the VUS of the traditional ordinal regression model (OR) were 0.352 and 0.322, respectively. Consistent analysis results were also observed for the knowledge-transfer-based models based on the SIRS/QSOFA scoring systems in the ordinal scenarios. Additionally, the predicted probabilities and the binary classification ROC curves of the knowledge-transfer-based models indicated that this approach enhanced the predicted probabilities for the minority classes while reducing the predicted probabilities for the majority classes, which improved AUCs/VUSs on imbalanced data. Discussion: Knowledge transfer, which combines a medical scoring system and a machine-learning-based model, improves the prediction performance for early diagnosis of sepsis, especially in the scenarios of class imbalance and limited sample size.

[Splenoportography in primary cancer of the liver].

Prediction of sepsis within 24 hours at the triage stage in emergency departments using machine learning

Interpretable Machine Learning for Early Prediction of Prognosis in Sepsis: A Discovery and Validation Study

A machine-learning approach for dynamic prediction of sepsis-induced coagulopathy in critically ill patients with sepsis: an integrated analysis of the MIMIC-IV and eICU-CRD databases

Early Prediction of Mortality, Severity, and Length of Stay in the Intensive Care Unit of Sepsis Patients Based on Sepsis 3.0 by Machine Learning Models

Prediction of Sepsis Mortality in ICU Patients Using Machine Learning Methods

An early sepsis prediction model utilizing machine learning and unbalanced data processing in a clinical context

Early sepsis mortality prediction model based on interpretable machine learning approach: development and validation study

A Machine-Learning Approach for Dynamic Prediction of Sepsis-Induced Coagulopathy in Critically Ill Patients With Sepsis

Predicting sepsis using deep learning across international sites: a retrospective development and validation study

Using machine learning methods to predict in-hospital mortality of sepsis patients in the ICU

A Machine Learning Model for Accurate Prediction of Sepsis in ICU Patients

An Interpretable Machine Learning Model for Accurate Prediction of Sepsis in the ICU

Multicentre Validation of a Sepsis Prediction Algorithm Using Only Vital Sign Data in the Emergency Department, General Ward and ICU

Interpretable Machine Learning to Optimize Early In-Hospital Mortality Prediction for Elderly Patients with Sepsis: A Discovery Study

A Customised Down-sampling Machine Learning Approach for Sepsis Prediction

An interpretable machine learning model for real-time sepsis prediction based on basic physiological indicators

Real-Time Prediction of Sepsis in Critical Trauma Patients: Machine Learning–Based Modeling Study

SEPRES: Sepsis prediction via the clinical data integration system in the ICU

Prediction and risk assessment of sepsis-associated encephalopathy in ICU based on interpretable machine learning

A knowledge-transfer-based approach for combining ordinal regression and medical scoring system in the early prediction of sepsis with electronic health records