Abstract:Objectives: Emergency department (ED) overcrowding presents a global challenge that inhibits prompt care for critically ill patients. Traditional 5-level triage system that heavily rely on the judgment of the triage staff could fail to detect subtle symptoms in critical patients, thus leading to delayed treatment. Unlike previous rivalry-focused approaches, our study aimed to establish a collaborative machine learning (ML) model that renders risk scores for severe illness, which may assist the triage staff to provide a better patient stratification for timely critical cares. Methods: This retrospective study was conducted at a tertiary teaching hospital. Data were collected from January 2015 to October 2022. Demographic and clinical information were collected at triage. The study focused on severe illness as the outcome. We developed artificial neural network (ANN) models, with or without utilizing the Taiwan Triage and Acuity Scale (TTAS) score as one of the predictors. The model using the TTAS score is termed a machine-human collaborative model (ANN-MH), while the model without it is referred to as a machine-only model (ANN-MO). The predictive power of these models was assessed using the area under the receiver-operating-characteristic (AUROC) and the precision-recall curves (AUPRC); their sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1 score were compared. Results: The study analyzed 668,602 ED visits from 2015 to 2022. Among them, 278,724 visits from 2015 to 2018 were used for model training and validation, while 320,201 visits from 2019 to 2022 were for testing model performance. Approximately 2.6% of visits were by severely ill patients, whose TTAS scores ranged from 1 to 5. The ANN-MH model achieved a testing AUROC of 0.918 and AUPRC of 0.369, while for the ANN-MO model the AUROC and AUPRC were 0.909 and 0.339, respectively. Based on these metrics, the ANN-MH model outperformed the ANN-MO model, and both surpassed human triage classification. Subgroup analyses further highlighted the models' capability to identify higher-risk patients within the same triage level. Conclusions: The traditional 5-level triage system often falls short, leading to under-triage of critical patients. Our models include a score-based differentiation within a triage level to offer advanced risk stratification, thereby promoting patient safety.

Enhancing pneumonia prognosis in the emergency department: a novel machine learning approach using complete blood count and differential leukocyte count combined with CURB-65 score

Using machine learning to predict bacteremia in urgent care patients on the basis of triage data and laboratory results

Using machine learning tools to predict outcomes for emergency department intensive care unit patients

Development and validation of machine learning-based prediction model for severe pneumonia: A multicenter cohort study

Integrating ensemble and machine learning models for early prediction of pneumonia mortality using laboratory tests

Predicting Clinical Outcomes in COVID-19 and Pneumonia Patients: A Machine Learning Approach

Predicting outcomes in older ED patients with influenza in real time using a big data-driven and machine learning approach to the hospital information system

Moving from Predicting Hospital Deaths by Antibiotic-Resistant Bloodstream Bacteremia Toward Actionable Risk Reduction Using Machine Learning on Electronic Health Records.

Machine learning-based prediction of in-ICU mortality in pneumonia patients

Clinical Applicable AI System Based on Deep Learning Algorithm for Differentiation of Pulmonary Infectious Disease

Machine learning models to evaluate mortality in pediatric patients with pneumonia in the intensive care unit

A machine learning model for early candidemia prediction in the intensive care unit: Clinical application

Development of a COVID-19 early risk assessment system based on multiple machine learning algorithms and routine blood tests: a real-world study

Prediction of viral pneumonia based on machine learning models analyzing pulmonary inflammation index scores

Identifying severe community-acquired pneumonia using radiomics and clinical data: a machine learning approach

Combination of machine learning algorithms with natural language processing may increase the probability of bacteremia detection in the emergency department: A retrospective, big-data analysis of 94,482 patients

Application of Machine Learning Techniques to Development of Emergency Medical Rapid Triage Prediction Models in Acute Care

Machine Learning Interpretability Methods to Characterize the Importance of Hematologic Biomarkers in Prognosticating Patients with Suspected Infection

Real-Time Artificial Intelligence System for Bacteremia Prediction in Adult Febrile Emergency Department Patients

Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms

Patient stratification based on the risk of severe illness in emergency departments through collaborative machine learning models