Abstract:Background: Despite its high lethality, sepsis can be difficult to detect on initial presentation to the emergency department (ED). Machine learning-based tools may provide avenues for earlier detection and lifesaving intervention. Objective: The study aimed to predict sepsis at the time of ED triage using natural language processing of nursing triage notes and available clinical data. Methods: We constructed a retrospective cohort of all 1,234,434 consecutive ED encounters in 2015-2021 from 4 separate clinically heterogeneous academically affiliated EDs. After exclusion criteria were applied, the final cohort included 1,059,386 adult ED encounters. The primary outcome criteria for sepsis were presumed severe infection and acute organ dysfunction. After vectorization and dimensional reduction of triage notes and clinical data available at triage, a decision tree-based ensemble (time-of-triage) model was trained to predict sepsis using the training subset (n=950,921). A separate (comprehensive) model was trained using these data and laboratory data, as it became available at 1-hour intervals, after triage. Model performances were evaluated using the test (n=108,465) subset. Results: Sepsis occurred in 35,318 encounters (incidence 3.45%). For sepsis prediction at the time of patient triage, using the primary definition, the area under the receiver operating characteristic curve (AUC) and macro F1-score for sepsis were 0.94 and 0.61, respectively. Sensitivity, specificity, and false positive rate were 0.87, 0.85, and 0.15, respectively. The time-of-triage model accurately predicted sepsis in 76% (1635/2150) of sepsis cases where sepsis screening was not initiated at triage and 97.5% (1630/1671) of cases where sepsis screening was initiated at triage. Positive and negative predictive values were 0.18 and 0.99, respectively. For sepsis prediction using laboratory data available each hour after ED arrival, the AUC peaked to 0.97 at 12 hours. Similar results were obtained when stratifying by hospital and when Centers for Disease Control and Prevention hospital toolkit for adult sepsis surveillance criteria were used to define sepsis. Among septic cases, sepsis was predicted in 36.1% (1375/3814), 49.9% (1902/3814), and 68.3% (2604/3814) of encounters, respectively, at 3, 2, and 1 hours prior to the first intravenous antibiotic order or where antibiotics where not ordered within the first 12 hours. Conclusions: Sepsis can accurately be predicted at ED presentation using nursing triage notes and clinical information available at the time of triage. This indicates that machine learning can facilitate timely and reliable alerting for intervention. Free-text data can improve the performance of predictive modeling at the time of triage and throughout the ED course.

The impact of laboratory data missingness on sepsis diagnosis timeliness

The Impact of Common Variations in Sequential Organ Failure Assessment Score Calculation on Sepsis Measurement Using Sepsis-3 Criteria: A Retrospective Analysis Using Electronic Health Record Data

AME Evidence Series 001-the Society for Translational Medicine: Clinical Practice Guidelines for Diagnosis and Early Identification of Sepsis in the Hospital

Early diagnosis of sepsis in emergency departments, time to treatment, and association with mortality: An observational study

Prolonged Length of Stay in the Emergency Department and Increased Risk of Hospital Mortality in Patients with Sepsis Requiring ICU Admission

Performance of bedside tools for predicting infection-related mortality and administrative data for sepsis surveillance: An observational cohort study

Development of an Electronic Clinical Surveillance Measure for Unnecessary Rapid Antibiotic Administration in Suspected Sepsis

Association Between Medicare’s Sepsis Reporting Policy (SEP-1) and the Documentation of a Sepsis Diagnosis in the Clinical Record

Trend of mortality and length of stay in the emergency department following implementation of a centralized sepsis alert system

Detection of sepsis during emergency department triage using machine learning

Sepsis Prediction at Emergency Department Triage Using Natural Language Processing: Retrospective Cohort Study

Evaluating the implementation and outcomes of a sepsis pathway in the emergency department

Increasing the Density of Laboratory Measures for Machine Learning Applications

Early Physician Gestalt Versus Usual Screening Tools for the Prediction of Sepsis in Critically Ill Emergency Patients

Deficits in blood culture collection in the emergency department if sepsis is suspected: results of a retrospective cohort study

Comparison of Sepsis Definitions as Automated Criteria

Can We Improve Mortality Prediction in Patients with Sepsis in the Emergency Department?

Quick Sequential Organ Failure Assessment, Sequential Organ Failure Assessment, and Procalcitonin for Early Diagnosis and Prediction of Death in Elderly Patients with Suspicion of Sepsis in the Emergency Department, Based on Sepsis-3 Definition

The Changing Paradigm of Sepsis: Early Diagnosis, Early Antibiotics, Early Pressors, and Early Adjuvant Treatment.

SEPSIGN: early identification of sepsis signs in emergency department

Effectiveness and Safety of an Emergency Department Code Sepsis Protocol: A Pragmatic Clinical Trial