Abstract:Background: Symptom-checkers have become important tools for self-triage, assisting patients to determine the urgency of medical care. To be safe and effective, these tools must be validated, particularly to avoid potentially hazardous undertriage without leading to inefficient overtriage. Only limited safety data from studies including small sample sizes have been available so far. Objective: The objective of our study was to prospectively investigate the safety of patients' self-triage in a large patient sample. We used SMASS (Swiss Medical Assessment System; in4medicine, Inc) pathfinder, a symptom-checker based on a computerized transparent neural network. Methods: We recruited 2543 patients into this single-center, prospective clinical trial conducted at the cantonal hospital of Baden, Switzerland. Patients with an Emergency Severity Index of 1-2 were treated by the team of the emergency department, while those with an index of 3-5 were seen at the walk-in clinic by general physicians. We compared the triage recommendation obtained by the patients' self-triage with the assessment of clinical urgency made by 3 successive interdisciplinary panels of physicians (panels A, B, and C). Using the Clopper-Pearson CI, we assumed that to confirm the symptom-checkers' safety, the upper confidence bound for the probability of a potentially hazardous undertriage should lie below 1%. A potentially hazardous undertriage was defined as a triage in which either all (consensus criterion) or the majority (majority criterion) of the experts of the last panel (panel C) rated the triage of the symptom-checker to be "rather likely" or "likely" life-threatening or harmful. Results: Of the 2543 patients, 1227 (48.25%) were female and 1316 (51.75%) male. None of the patients reached the prespecified consensus criterion for a potentially hazardous undertriage. This resulted in an upper 95% confidence bound of 0.1184%. Further, 4 cases met the majority criterion. This resulted in an upper 95% confidence bound for the probability of a potentially hazardous undertriage of 0.3616%. The 2-sided 95% Clopper-Pearson CI for the probability of overtriage (n=450 cases,17.69%) was 16.23% to 19.24%, which is considerably lower than the figures reported in the literature. Conclusions: The symptom-checker proved to be a safe triage tool, avoiding potentially hazardous undertriage in a real-life clinical setting of emergency consultations at a walk-in clinic or emergency department without causing undesirable overtriage. Our data suggest the symptom-checker may be safely used in clinical routine. Trial registration: ClinicalTrials.gov NCT04055298; https://clinicaltrials.gov/study/NCT04055298.

Reliability and Accuracy of the Pediatric Swiss Emergency Triage Scale—the SETSped Study

Reliability and Validity of the Four-Level Chinese Emergency Triage Scale in Mainland China: A Multicenter Assessment

Prioritizing Pediatric Emergency Triage—Sorting Out the Challenges

Emergency Severity Index Version 4 and Triage of Pediatric Emergency Department Patients

Nurses' accuracy and self-perceived ability using the Emergency Severity Index triage tool: a cross-sectional study in four Swiss hospitals

Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population

Application of trauma assessing method to a emergency triage

The reliability and validity of triage tools in geriatric emergency departments: A scoping review

The Diagnostic Evaluation of the SINEH Cardiopulmonary Triage Scale and the Emergency Severity Index in the Emergency Department: A Comparative Study

Validation and comparison of triage-based screening strategies for sepsis

A Symptom-Checker for Adult Patients Visiting an Interdisciplinary Emergency Care Center and the Safety of Patient Self-Triage: Real-Life Prospective Evaluation

Triage capabilities of medical trainees in Ghana using the South African triage scale: an opportunity to improve emergency care

Unique triage methods in the paediatric emergency roomof a low resource setting

Variation in prehospital use and uptake of the national Field Triage Decision Scheme

Validation of motor component of Glasgow coma scale in lieu of total Glasgow coma scale as a pediatric trauma field triage tool

The effectiveness of a modified Manchester Triage System for geriatric patients: A retrospective quantitative study

Changes in Relative Importance of the 5-Level Triage System, Korean Triage and Acuity Scale, for the Disposition of Emergency Patients Induced by Forced Reduction in Its Level Number: a Multi-Center Registry-based Retrospective Cohort Study

Outcomes of Chengdu Pediatric Emergency Triage Criteria: A Retrospective Study of 198,628 Pediatric Patient Records

Audit of a computerized version of the Manchester triage system and a SIRS-based system for the detection of sepsis at triage in the emergency department

Pediatric Emergency Department Study of Cardiac Risk in the Novel Patient (PED SCReeN)

A comparison of self-triage tools to nurse driven triage in the emergency department