Abstract:Background: Chest pain is a common symptom that presents to the emergency department (ED), and its causes range from minor illnesses to serious diseases such as acute coronary syndrome. Accurate and timely diagnosis is essential for the efficient management and treatment of these patients. Objective: This study aims to expand on a model previously developed by the Chi Mei Medical Group (CMMG) Emergency Department in 2020 to predict adverse cardiac events in patients with chest pain. The main goal is to evaluate the accuracy and generalizability of the model through external validation using data from other hospitals. Methods: The initial model for this study was developed using data from three CMMG-affiliated hospitals in southern Taiwan. We utilized four supervised machine learning algorithms, namely random forest, logistic regression, support-vector clustering, and K-nearest neighbor, to predict the risk of acute myocardial infarction within a one month for emergency chest pain patients. The study used the model with the best area under the curve (AUC), recall and precision for external validation. The external validated data source was data collected from three hospitals associated with Taipei Medical University (TMU) in northern Taiwan. Results: The original best model constructed by CMMG exhibited an AUC of 0.822, an accuracy of 0.740, a recall of 0.741, a precision of 0.566, a specificity of 0.740, and an NPV of 0.861. Subsequently, during the external validation phase, CMMG's top-performing model demonstrated acceptable validation result with TMU's data, achieving an AUC of 0.63, an accuracy of 0.661, a recall of 0.593, a precision of 0.243, a specificity of 0.691, and an NPV of 0.900. While the results indicate that the model's performance varied across different datasets and are not outstanding, the model is still acceptable for clinical application as a preliminary decision-support tool. Conclusion: This study highlights the importance of external validation to confirm the applicability of the previously developed predictive model in other hospital settings. Although the model shows potential in assessing chest pain patients in the ED, its broad clinical application requires further validation to ensure it can improve patient outcomes and optimize healthcare resource allocation.

Development of a prehospital prediction model for risk stratification of patients with chest pain

Prehospital stratification in acute chest pain patient into high risk and low risk by emergency medical service: a prospective cohort study

Acute myocardial infarction risk prediction in emergency chest pain patients: An external validation study

Development of an Initial Screening Scale to Detect Patients With Chest Pain From Acute Coronary Syndrome in the Emergency Department

Effective Combination Of Isolated Symptom Variables To Help Stratifying Acute Undifferentiated Chest Pain In The Emergency Department

Predicting acute coronary syndrome in males and females with chest pain who call an emergency medical communication centre

Development of a prediction model for emergency medical service witnessed traumatic out-of-hospital cardiac arrest: A multicenter cohort study

A prediction model for patients with emergency medical service witnessed out-of-hospital cardiac arrest

Development and validation of a prediction rule for patients suspected of acute coronary syndrome in primary care: a cross-sectional study

Establishment of a nomogram model for acute chest pain triage in the chest pain center

Machine learning for early prediction of acute myocardial infarction or death in acute chest pain patients using electrocardiogram and blood tests at presentation

Accuracy of emergency medical services (EMS) telephone triage in identifying acute coronary syndrome (ACS) for patients with chest pain: a systematic literature review

Preclinical identification of acute coronary syndrome without high sensitivity troponin assays using machine learning algorithms

A validation of machine learning-based risk scores in the prehospital setting

A prediction model for prehospital clinical deterioration: The use of early warning scores

Are medical history data fit for risk stratification of patients with chest pain in emergency care? Comparing data collected from patients using computerized history taking with data documented by physicians in the electronic health record in the CLEOS-CPDS prospective cohort study

Application Value of NLR, PLR, LMR, HEART score, and POCT in Early Warning and Accurate Graded Diagnosis of High-Risk Chest Pain in Emergency Medicine

Prediction of Short-Term Mortality in Acute Heart Failure Patients Using Minimal Electronic Health Record Data

Predictive Factors and Risk Assessment for Hospitalization in Chest Pain Patients Admitted to the Emergency Department

Factors Influencing Utilization of Pre-Emergency Medical Services in Patients with Acute Chest Pain

Emergency department routine data and the diagnosis of acute ischemic heart disease in patients with atypical chest pain