Abstract:BackgroundDevelopment of emergency department (ED) triage systems that accurately differentiate and prioritize critically ill from stable patients remains challenging. We used machine learning models to predict clinical outcomes, and then compared their performance with that of a conventional approach—the Emergency Severity Index (ESI).MethodsUsing National Hospital and Ambulatory Medical Care Survey (NHAMCS) ED data, from 2007 through 2015, we identified all adult patients (aged ≥ 18 years). In the randomly sampled training set (70%), using routinely available triage data as predictors (e.g., demographics, triage vital signs, chief complaints, comorbidities), we developed four machine learning models: Lasso regression, random forest, gradient boosted decision tree, and deep neural network. As the reference model, we constructed a logistic regression model using the five-level ESI data. The clinical outcomes were critical care (admission to intensive care unit or in-hospital death) and hospitalization (direct hospital admission or transfer). In the test set (the remaining 30%), we measured the predictive performance, including area under the receiver-operating-characteristics curve (AUC) and net benefit (decision curves) for each model.ResultsOf 135,470 eligible ED visits, 2.1% had critical care outcome and 16.2% had hospitalization outcome. In the critical care outcome prediction, all four machine learning models outperformed the reference model (e.g., AUC, 0.86 [95%CI 0.85–0.87] in the deep neural network vs 0.74 [95%CI 0.72–0.75] in the reference model), with less under-triaged patients in ESI triage levels 3 to 5 (urgent to non-urgent). Likewise, in the hospitalization outcome prediction, all machine learning models outperformed the reference model (e.g., AUC, 0.82 [95%CI 0.82–0.83] in the deep neural network vs 0.69 [95%CI 0.68–0.69] in the reference model) with less over-triages in ESI triage levels 1 to 3 (immediate to urgent). In the decision curve analysis, all machine learning models consistently achieved a greater net benefit—a larger number of appropriate triages considering a trade-off with over-triages—across the range of clinical thresholds.ConclusionsCompared to the conventional approach, the machine learning models demonstrated a superior performance to predict critical care and hospitalization outcomes. The application of modern machine learning models may enhance clinicians’ triage decision making, thereby achieving better clinical care and optimal resource utilization.

Risk Stratification with Extreme Learning Machine: A Retrospective Study on Emergency Department Patients

Ensemble-Based Risk Scoring with Extreme Learning Machine for Prediction of Adverse Cardiac Events

Analysis Of Patient Outcome Using Ecg And Extreme Learning Machine Ensemble

Credit Risk Evaluation with Extreme Learning Machine

Extreme learning machine for mammographie risk analysis

Risk Factors of Heart Failure for Patients Classification with Extreme Learning Machine

Practical Method for ECG Classification Using Weighted ELM

Using machine learning tools to predict outcomes for emergency department intensive care unit patients

Machine Learning For Risk Prediction After Heart Failure Emergency Department Visit or Hospital Admission Using Administrative Health Data

Emergency department triage prediction of clinical outcomes using machine learning models

Risk Prediction for Non-cardiac Surgery Using the 12-Lead Electrocardiogram: An Explainable Deep Learning Approach

Patient stratification based on the risk of severe illness in emergency departments through collaborative machine learning models

Machine Learning Based Early Mortality Prediction in the Emergency Department.

Application of Machine Learning Techniques to Development of Emergency Medical Rapid Triage Prediction Models in Acute Care

Development and validation of a machine learning framework for improved resource allocation in the emergency department

Prediction of high-risk emergency department revisits from a machine-learning algorithm: a proof-of-concept study

Clinical narrative-aware deep neural network for emergency department critical outcome prediction

Eeg-Based Vigilance Estimation Using Extreme Learning Machines

Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions

A machine learning-based risk stratification tool for in-hospital mortality of intensive care unit patients with heart failure

Risk of mortality and cardiopulmonary arrest in critical patients presenting to the emergency department using machine learning and natural language processing