Abstract:Background: Chest pain is a common symptom that presents to the emergency department (ED), and its causes range from minor illnesses to serious diseases such as acute coronary syndrome. Accurate and timely diagnosis is essential for the efficient management and treatment of these patients. Objective: This study aims to expand on a model previously developed by the Chi Mei Medical Group (CMMG) Emergency Department in 2020 to predict adverse cardiac events in patients with chest pain. The main goal is to evaluate the accuracy and generalizability of the model through external validation using data from other hospitals. Methods: The initial model for this study was developed using data from three CMMG-affiliated hospitals in southern Taiwan. We utilized four supervised machine learning algorithms, namely random forest, logistic regression, support-vector clustering, and K-nearest neighbor, to predict the risk of acute myocardial infarction within a one month for emergency chest pain patients. The study used the model with the best area under the curve (AUC), recall and precision for external validation. The external validated data source was data collected from three hospitals associated with Taipei Medical University (TMU) in northern Taiwan. Results: The original best model constructed by CMMG exhibited an AUC of 0.822, an accuracy of 0.740, a recall of 0.741, a precision of 0.566, a specificity of 0.740, and an NPV of 0.861. Subsequently, during the external validation phase, CMMG's top-performing model demonstrated acceptable validation result with TMU's data, achieving an AUC of 0.63, an accuracy of 0.661, a recall of 0.593, a precision of 0.243, a specificity of 0.691, and an NPV of 0.900. While the results indicate that the model's performance varied across different datasets and are not outstanding, the model is still acceptable for clinical application as a preliminary decision-support tool. Conclusion: This study highlights the importance of external validation to confirm the applicability of the previously developed predictive model in other hospital settings. Although the model shows potential in assessing chest pain patients in the ED, its broad clinical application requires further validation to ensure it can improve patient outcomes and optimize healthcare resource allocation.

The diagnostic accuracy of cardiac ultrasound for acute myocardial ischemia in the emergency department: a systematic review and meta-analysis

Diagnostic Value of Bedside Echocardiography with Simple A-F Mnemonic Within 5 Minutes by Beginners in Patients with Acute Chest Pain

Role of Transthoracic Lung Ultrasonography in the Diagnosis of Pulmonary Embolism: A Systematic Review and Meta-Analysis

Diagnostic Accuracy of Contrast Enhanced Ultrasound in Patients with Blunt Abdominal Trauma Presenting to the Emergency Department: a Systematic Review and Meta-Analysis

Diagnostic efficacy of lung ultrasound in cardiogenic pulmonary edema: a systematic review and meta-analysis.

Diagnostic Performance of Point-of-Care High-Sensitivity Troponin in the Exclusion of Non-ST-Elevation Myocardial Infarction in the Emergency Department

Diagnostic performance of coronary calcifications on CT to rule out acute coronary syndrome in the emergency department

Quantitative myocardial contrast echocardiography during pharmacological stress for diagnosis of coronary artery disease: a systematic review and meta-analysis of diagnostic accuracy studies

Accuracy of emergency medical services (EMS) telephone triage in identifying acute coronary syndrome (ACS) for patients with chest pain: a systematic literature review

The role of coronary CT angiography for acute chest pain in the era of high-sensitivity troponins

Update on the emergency department diagnosis and risk stratification of acute chest pain

Diagnostic accuracy of prehospital lung ultrasound for acute decompensated heart failure: A systematic review and meta-analysis

Regional wall motion abnormalities on focused transthoracic echocardiography in patients presenting with acute chest pain: a predefined post hoc analysis of the prospective single-centre observational EPIC-ACS study

Chest pain CT in the Emergency Department: evaluating the coronary arteries even when not specifically asked for?

Multi-Marker Approach in Patients with Acute Chest Pain in the Emergency Department

A new score for the diagnosis of acute coronary syndrome in acute chest pain with non-diagnostic ECG and normal troponin

Acute myocardial infarction risk prediction in emergency chest pain patients: An external validation study

Scoring systems for the triage and assessment of short-term cardiovascular risk in patients with acute chest pain

Point‐of‐care ultrasound for aiding diagnosis of congestive heart failure in the emergency department: A narrative review

Improvement of Emergency Department Chest Pain Evaluation Using Hs-cTnT and a Risk Stratification Pathway

A systematic review of the applicability of emergency department assessment of chest pain score‐accelerated diagnostic protocol for risk stratification of patients with chest pain