Abstract:This study addresses the challenges associated with emergency department (ED) overcrowding and emphasizes the need for efficient risk stratification tools to identify high-risk patients for early intervention. While several scoring systems, often based on logistic regression (LR) models, have been proposed to indicate patient illness severity, this study aims to compare the predictive performance of ensemble learning (EL) models with LR for in-hospital mortality in the ED. A cross-sectional single-center study was conducted at the ED of Imam Reza Hospital in northeast Iran from March 2016 to March 2017. The study included adult patients with one to three levels of emergency severity index. EL models using Bagging, AdaBoost, random forests (RF), Stacking and extreme gradient boosting (XGB) algorithms, along with an LR model, were constructed. The training and validation visits from the ED were randomly divided into 80% and 20%, respectively. After training the proposed models using tenfold cross-validation, their predictive performance was evaluated. Model performance was compared using the Brier score (BS), The area under the receiver operating characteristics curve (AUROC), The area and precision–recall curve (AUCPR), Hosmer–Lemeshow (H–L) goodness-of-fit test, precision, sensitivity, accuracy, F1-score, and Matthews correlation coefficient (MCC). The study included 2025 unique patients admitted to the hospital's ED, with a total percentage of hospital deaths at approximately 19%. In the training group and the validation group, 274 of 1476 (18.6%) and 152 of 728 (20.8%) patients died during hospitalization, respectively. According to the evaluation of the presented framework, EL models, particularly Bagging, predicted in-hospital mortality with the highest AUROC (0.839, CI (0.802–0.875)) and AUCPR = 0.64 comparable in terms of discrimination power with LR (AUROC (0.826, CI (0.787–0.864)) and AUCPR = 0.61). XGB achieved the highest precision (0.83), sensitivity (0.831), accuracy (0.842), F1-score (0.833), and the highest MCC (0.48). Additionally, the most accurate models in the unbalanced dataset belonged to RF with the lowest BS (0.128). Although all studied models overestimate mortality risk and have insufficient calibration ( P > 0.05), stacking demonstrated relatively good agreement between predicted and actual mortality. EL models are not superior to LR in predicting in-hospital mortality in the ED. Both EL and LR models can be considered as screening tools to identify patients at risk of mortality.

Predicting mortality in geriatric patients with fever in the emergency departments: a prospective validation study

Performance of the MEDS Score in Predicting Mortality among Emergency Department Patients with a Suspected Infection: a Meta-Analysis

Performance of the MEDS score in predicting mortality among emergency department patients with a suspected infection: a meta-analysis.

Development of a Clinical Score for Predicting 28-Day Mortality in Geriatric Sepsis Patients; a Cohort study

Geriatric syndromes predict mortality of people aged 75+ years in the observation room of emergency department: Towards function-centric emergency medicine

Risk Factors and Scoring Systems to Predict the Mortality Risk of Afebrile Adult Patients with Monomicrobial Gram-Negative Bacteremia: A 10-Year Observational Study in the Emergency Department

Addition of the clinical frailty scale to triage tools and early warning scores improves mortality prognostication at 30 days: A prospective observational multicenter study

Internal Validation of the Predictive Performance of Models Based on Three ED and ICU Scoring Systems to Predict Inhospital Mortality for Intensive Care Patients Referred from the Emergency Department

Pneumonia in Geriatric Patients and Prediction of Mortality Based on the Pneumonia Severity Index (PSI), CURB-65, Frailty Index (FI), and FI-Lab21 Scores

Factors for predicting 28‐day mortality in older patients with suspected of having sepsis in the emergency department

Predicting short-term adverse outcomes in the geriatric population presenting with syncope: a comparison of existing syncope rules and beyond

The effectiveness of a modified Manchester Triage System for geriatric patients: A retrospective quantitative study

Establishment and validation of a prognostic nomogram for severe fever with thrombocytopenia syndrome: A retrospective observational study

Combining quick sequential organ failure assessment score with heart rate variability may improve predictive ability for mortality in septic patients at the emergency department

A comparative study of explainable ensemble learning and logistic regression for predicting in-hospital mortality in the emergency department

Predicting mortality in febrile adults: comparative performance of the MEWS, qSOFA, and UVA scores using prospectively collected data among patients in four health-care sites in sub-Saharan Africa and South-Eastern Asia

Development and validation of a parsimonious and pragmatic CHARM score to predict mortality in patients with suspected sepsis

Prediction of prognosis in patients with severe fever with thrombocytopenia syndrome

Can We Improve Mortality Prediction in Patients with Sepsis in the Emergency Department?

Development and validation of prognostic machine learning models for short- and long-term mortality among acutely admitted patients based on blood tests

Mortality and Prognostic Prediction in Very Elderly Patients With Severe Pneumonia