Abstract:Background: Despite its high lethality, sepsis can be difficult to detect on initial presentation to the emergency department (ED). Machine learning-based tools may provide avenues for earlier detection and lifesaving intervention. Objective: The study aimed to predict sepsis at the time of ED triage using natural language processing of nursing triage notes and available clinical data. Methods: We constructed a retrospective cohort of all 1,234,434 consecutive ED encounters in 2015-2021 from 4 separate clinically heterogeneous academically affiliated EDs. After exclusion criteria were applied, the final cohort included 1,059,386 adult ED encounters. The primary outcome criteria for sepsis were presumed severe infection and acute organ dysfunction. After vectorization and dimensional reduction of triage notes and clinical data available at triage, a decision tree-based ensemble (time-of-triage) model was trained to predict sepsis using the training subset (n=950,921). A separate (comprehensive) model was trained using these data and laboratory data, as it became available at 1-hour intervals, after triage. Model performances were evaluated using the test (n=108,465) subset. Results: Sepsis occurred in 35,318 encounters (incidence 3.45%). For sepsis prediction at the time of patient triage, using the primary definition, the area under the receiver operating characteristic curve (AUC) and macro F1-score for sepsis were 0.94 and 0.61, respectively. Sensitivity, specificity, and false positive rate were 0.87, 0.85, and 0.15, respectively. The time-of-triage model accurately predicted sepsis in 76% (1635/2150) of sepsis cases where sepsis screening was not initiated at triage and 97.5% (1630/1671) of cases where sepsis screening was initiated at triage. Positive and negative predictive values were 0.18 and 0.99, respectively. For sepsis prediction using laboratory data available each hour after ED arrival, the AUC peaked to 0.97 at 12 hours. Similar results were obtained when stratifying by hospital and when Centers for Disease Control and Prevention hospital toolkit for adult sepsis surveillance criteria were used to define sepsis. Among septic cases, sepsis was predicted in 36.1% (1375/3814), 49.9% (1902/3814), and 68.3% (2604/3814) of encounters, respectively, at 3, 2, and 1 hours prior to the first intravenous antibiotic order or where antibiotics where not ordered within the first 12 hours. Conclusions: Sepsis can accurately be predicted at ED presentation using nursing triage notes and clinical information available at the time of triage. This indicates that machine learning can facilitate timely and reliable alerting for intervention. Free-text data can improve the performance of predictive modeling at the time of triage and throughout the ED course.

Toward Automated Early Sepsis Alerting: Identifying Infection Patients from Nursing Notes

Development of an Early Warning System for Sepsis.

Artificial intelligence in sepsis early prediction and diagnosis using unstructured data in healthcare

Early detection of sepsis utilizing deep learning on electronic health record event sequences

Sepsis Prediction at Emergency Department Triage Using Natural Language Processing: Retrospective Cohort Study

Early Detection of Sepsis using Machine Learning

EARLY PREDICTION OF SEPSIS USING MACHINE LEARNING ALGORITHM: A BRIEF CLINICAL PERSPECTIVE

Machine learning algorithms for early sepsis detection in the emergency department: A retrospective study

Detection of sepsis during emergency department triage using machine learning

Early Prediction of Sepsis in EMR Records Using Traditional ML Techniques and Deep Learning LSTM Networks

Machine Learning Models for Early Prediction of Sepsis on Large Healthcare Datasets

Supervised machine learning for early predicting the sepsis patient: modified mean imputation and modified chi-square feature selection

Improving Early Sepsis Prediction with Multi Modal Learning

Improving sepsis prediction in intensive care with SepsisAI: A clinical decision support system with a focus on minimizing false alarms

Vital sign‐based detection of sepsis in neonates using machine learning

Development and validation of a sepsis risk index supporting early identification of ICU-acquired sepsis: An observational study

A Machine Learning Model Integrated with the Clinical Workflow Detects Sepsis Early with High Sensitivity and Specificity

A Machine Learning Model for Early Prediction and Detection of Sepsis in Intensive Care Unit Patients

Early Prediction of Mortality in Critical Care Setting in Sepsis Patients Using Structured Features and Unstructured Clinical Notes

Cross-center Early Sepsis Recognition by Medical Knowledge Guided Collaborative Learning for Data-scarce Hospitals

Advanced Meta-Ensemble Machine Learning Models for Early and Accurate Sepsis Prediction to Improve Patient Outcomes