Abstract:Many early warning algorithms are downstream of clinical evaluation and diagnostic testing, which means that they may not be useful when clinicians fail to suspect illness and fail to order appropriate tests. Depending on how such algorithms handle missing data, they could even indicate "low risk" simply because the testing data were never ordered. We considered predictive methodologies to identify sepsis at triage, before diagnostic tests are ordered, in a busy Emergency Department (ED). One algorithm used "bland clinical data" (data available at triage for nearly every patient). The second algorithm added three yes/no questions to be answered after the triage interview. Retrospectively, we studied adult patients from a single ED between 2014–16, separated into training (70%) and testing (30%) cohorts, and a final validation cohort of patients from four EDs between 2016–2018. Sepsis was defined per the Rhee criteria. Investigational predictors were demographics and triage vital signs (downloaded from the hospital EMR); past medical history; and the auxiliary queries (answered by chart reviewers who were blinded to all data except the triage note and initial HPI). We developed L2-regularized logistic regression models using a greedy forward feature selection. There were 1164, 499, and 784 patients in the training, testing, and validation cohorts, respectively. The bland clinical data model yielded ROC AUC's 0.78 (0.76–0.81) and 0.77 (0.73–0.81), for training and testing, respectively, and ranged from 0.74–0.79 in four hospital validation. The second model which included auxiliary queries yielded 0.84 (0.82–0.87) and 0.83 (0.79–0.86), and ranged from 0.78–0.83 in four hospital validation. The first algorithm did not require clinician input but yielded middling performance. The second showed a trend towards superior performance, though required additional user effort. These methods are alternatives to predictive algorithms downstream of clinical evaluation and diagnostic testing. For hospital early warning algorithms, consideration should be given to bias and usability of various methods. Predictive algorithms for hospitals often rely on the results of diagnostic tests as predictors for whether patients have serious and unexpected conditions. Strong predictive performance of such algorithms might be misleading for the following reason: doctors may not order the appropriate diagnostic tests unless they already have some level of concern about the patient, so the data will be available if doctors are already suspecting the correct diagnosis but not available in cases when doctors overlook the correct diagnosis. In this manuscript, we consider early sepsis identification and explore two alternative strategies for avoiding any reliance on diagnostic testing: the use of "bland" data that should be available on every single patient, and the use of a few objective "yes/no" questions that might be answered on patients with abnormal vital signs, to provide additional information for the predictive algorithms.

Mitophagy, mitochondrial spheroids, and mitochondrial-derived vesicles in alcohol-induced liver injury.

End user experience of a widely used artificial intelligence based sepsis system

Comparing the predictive ability of a commercial artificial intelligence early warning system with physician judgement for clinical deterioration in hospitalised general internal medicine patients: a prospective observational study

Performance of universal early warning scores in different patient subgroups and clinical settings: a systematic review

Nursing implications of an early warning system implemented to reduce adverse events: a qualitative study

Automotive Underhood E and H Field Sensors

Use of Artificial Intelligence in Early Warning Score in Critical ill Patients: Scoping Review

Explainable artificial intelligence model to predict acute critical illness from electronic health records

Clinician Perspectives on Decision Support and AI-based Decision Support in a Pediatric ED

Early Warning Systems for Critical Illness Outside the Intensive Care Unit

Clinician perspectives and recommendations regarding design of clinical prediction models for deteriorating patients in acute care

Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection

Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosis

Flow cytometric study of site-directed chemotherapy with estradiol-17 beta as a drug carrier to human endometrial adenocarcinoma cells in vitro.

Development and Validation of an Interpretable Conformal Predictor to Predict Sepsis Mortality Risk: Retrospective Cohort Study

Engaging clinicians early during the development of a graphical user display of an intelligent alerting system at the bedside

Factors driving provider adoption of the TREWS machine learning-based early warning system and its effects on sepsis treatment timing

EventScore: An Automated Real-time Early Warning Score for Clinical Events

Nurse by numbers: The impact of early warning systems on nurses' higher‐order thinking, a quantitative study

Hypervariable regions, idiotypy, and the antibody-combining site.

Early Warning Scores With and Without Artificial Intelligence