Abstract:Background: Guidelines for sepsis recommend treating those at highest risk within 1 hour. The emergency care system can only achieve this if sepsis is recognised and prioritised. Ambulance services can use prehospital early warning scores alongside paramedic diagnostic impression to prioritise patients for treatment or early assessment in the emergency department. Objectives: To determine the accuracy, impact and cost-effectiveness of using early warning scores alongside paramedic diagnostic impression to identify sepsis requiring urgent treatment. Design: Retrospective diagnostic cohort study and decision-analytic modelling of operational consequences and cost-effectiveness. Setting: Two ambulance services and four acute hospitals in England. Participants: Adults transported to hospital by emergency ambulance, excluding episodes with injury, mental health problems, cardiac arrest, direct transfer to specialist services, or no vital signs recorded. Interventions: Twenty-one early warning scores used alongside paramedic diagnostic impression, categorised as sepsis, infection, non-specific presentation, or other specific presentation. Main outcome measures: Proportion of cases prioritised at the four hospitals; diagnostic accuracy for the sepsis-3 definition of sepsis and receiving urgent treatment (primary reference standard); daily number of cases with and without sepsis prioritised at a large and a small hospital; the minimum treatment effect associated with prioritisation at which each strategy would be cost-effective, compared to no prioritisation, assuming willingness to pay £20,000 per quality-adjusted life-year gained. Results: Data from 95,022 episodes involving 71,204 patients across four hospitals showed that most early warning scores operating at their pre-specified thresholds would prioritise more than 10% of cases when applied to non-specific attendances or all attendances. Data from 12,870 episodes at one hospital identified 348 (2.7%) with the primary reference standard. The National Early Warning Score, version 2 (NEWS2), had the highest area under the receiver operating characteristic curve when applied only to patients with a paramedic diagnostic impression of sepsis or infection (0.756, 95% confidence interval 0.729 to 0.783) or sepsis alone (0.655, 95% confidence interval 0.63 to 0.68). None of the strategies provided high sensitivity (> 0.8) with acceptable positive predictive value (> 0.15). NEWS2 provided combinations of sensitivity and specificity that were similar or superior to all other early warning scores. Applying NEWS2 to paramedic diagnostic impression of sepsis or infection with thresholds of > 4, > 6 and > 8 respectively provided sensitivities and positive predictive values (95% confidence interval) of 0.522 (0.469 to 0.574) and 0.216 (0.189 to 0.245), 0.447 (0.395 to 0.499) and 0.274 (0.239 to 0.313), and 0.314 (0.268 to 0.365) and 0.333 (confidence interval 0.284 to 0.386). The mortality relative risk reduction from prioritisation at which each strategy would be cost-effective exceeded 0.975 for all strategies analysed. Limitations: We estimated accuracy using a sample of older patients at one hospital. Reliable evidence was not available to estimate the effectiveness of prioritisation in the decision-analytic modelling. Conclusions: No strategy is ideal but using NEWS2, in patients with a paramedic diagnostic impression of infection or sepsis could identify one-third to half of sepsis cases without prioritising unmanageable numbers. No other score provided clearly superior accuracy to NEWS2. Research is needed to develop better definition, diagnosis and treatments for sepsis. Study registration: This study is registered as Research Registry (reference: researchregistry5268). Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 17/136/10) and is published in full in Health Technology Assessment; Vol. 28, No. 16. See the NIHR Funding and Awards website for further award information.

The performance of screening tools and use of blood analyses in prehospital identification of sepsis patients and patients suitable for non-conveyance - an observational study

Screening strategies to identify sepsis in the prehospital setting: a validation study

Sepsis incidence, suspicion, prediction and mortality in emergency medical services: a cohort study related to the current international sepsis guideline

AME Evidence Series 001-the Society for Translational Medicine: Clinical Practice Guidelines for Diagnosis and Early Identification of Sepsis in the Hospital

Early Physician Gestalt Versus Usual Screening Tools for the Prediction of Sepsis in Critically Ill Emergency Patients

Nurses’ and Physicians’ Experiences After Implementation of a Quality Improvement Project to Improve Sepsis Awareness in Hospitals

Patient safety and patient assessment in pre-hospital care: a study protocol

Detection of sepsis during emergency department triage using machine learning

Performance of bedside tools for predicting infection-related mortality and administrative data for sepsis surveillance: An observational cohort study

Prehospital early warning scores for adults with suspected sepsis: the PHEWS observational cohort and decision-analytic modelling study

SEPSIGN: early identification of sepsis signs in emergency department

Performance Characteristics of Sepsis Screening Tools During Delivery Admissions

Early diagnosis of sepsis in emergency departments, time to treatment, and association with mortality: An observational study

Scores for sepsis detection and risk stratification - construction of a novel score using a statistical approach and validation of RETTS

Toward Standardization and High Reliability: Improved Sepsis Screening in Emergency Department Triage Across an Academic Health System

Effectiveness of Automated Alerting System Compared to Usual Care for the Management of Sepsis

Early detection of sepsis using artificial intelligence: a scoping review protocol

Early Analysis of Endothelial Markers to predict Sepsis in the Emergency Department

Comparison of Manual and Automated Sepsis Screening Tools in a Pediatric Emergency Department

Integrating Routine Hematological and Extended Inflammatory Parameters as a Novel Approach for Timely Diagnosis and Prognosis in Sepsis Management

Low sensitivity of qSOFA, SIRS criteria and sepsis definition to identify infected patients at risk of complication in the prehospital setting and at the emergency department triage