Developing and Validating an Emergency Triage Model Using Machine Learning Algorithms with Medical Big Data
ZhenZhen Gao,Xuan Qi,XingTing Zhang,XinZhen Gao,XinHua He,ShuBin Guo,Peng Li
DOI: https://doi.org/10.2147/RMHP.S355176
2022-08-20
Risk Management and Healthcare Policy
Abstract:ZhenZhen Gao, 1, &ast Xuan Qi, 1, &ast XingTing Zhang, 2 XinZhen Gao, 2 XinHua He, 1 ShuBin Guo, 1 Peng Li 1 1 Department of Emergency, Beijing Chao-yang Hospital, Capital Medical University, Beijing, 100008, People's Republic of China; 2 LIANREN Digital Health Co., Ltd, Beijing, 102208, People's Republic of China &astThese authors contributed equally to this work Correspondence: Peng Li, Department of Emergency, Beijing Chao-yang Hospital, Capital Medical University, Beijing, 100008, People's Republic of China, Tel +86 010 85231280, Email Objective: To establish an emergency triage model through the statistical analysis of big data during a particular time period from a hospital information system to improve the accuracy of triage in emergency department (ED). Methods: A total of 276,164 patients who visited the Emergency Medicine Department of Beijing Chao-Yang Hospital from 2017 to 2020 were included in this study, including 123,392 men and 152,772 women aged from 14 to 112 years. The baseline characteristics (age and gender) and medical records (patient's condition, body temperature, heart rate, breathing, blood pressure, consciousness, and oxygen saturation) of the patients was collected. The data samples were randomly allocated, with 80% as the training set and 20% as the testing set. The patients were divided into levels I, II, III, and IV in accordance with a four-level triage standard. We selected the effective Extreme Gradient Boosting (XGBoost) algorithm as our emergency classification prediction model. The XGBoost model was applied to simulate the thinking process of triage nurses, and the De Long's test was used to compare the receiver operating characteristic (ROC) curve of different models. The P value was obtained by calculating the variance and covariance of area under the curve (AUC) values of different ROC curves. Results: Level I had 4960 (1.8%) patients, level II had 25,646 (9.29%), level III had 130,664 (47.31%), and level IV had 114,894 (41.6%). The XGBoost model was built following a logic exercise based on the traditional manual pre-inspection and triage results. After verification, the prediction accuracy was 82.57%. The AUC of each disease severity level (levels I, II, III, and IV) was 0.9629, 0.9554, 0.9120, and 0.9296, respectively. Conclusion: The emergency triage prediction model, which achieved a relatively strong accuracy rate, can reduce the work intensity of medical workers and improve their working efficiency. Keywords: emergency, triage, XGBoost model, triage model As the health-care system improves, emergency medicine has become a core and valuable specialized area. The development of emergency medicine has changed rapidly and no longer consists of a simple triage desk and transfer station. Instead, it has become a diagnosis and treatment center for emergency medicine and severe diseases, integrating multidisciplinary resources to complement medical, teaching, scientific research, social service, and other functions. 1 Since the 1990s, different emergency department (ED) triage systems have been used, such as the Australian Triage Scale, 2 Canadian Emergency Department Triage and Acuity Scale, 3 Manchester Triage Scale, 4 and the Emergency Severity Index. 5 Although these triage systems have been widely adopted by many EDs globally, limitations still exist, such as inaccurate triage. 6 Failure to distinguish the risk level of critically ill patients 7–9 can easily lead to undertriage or overtriage, both of which have a negative impact on the accuracy and efficiency of emergency resource allocation. The undertriage of patients with severe diseases can lead to an insufficient allocation of medical resources, resulting in increased clinical deterioration, morbidity, and mortality. 10,11 The overtriage of patients with non-urgent presentations can lead to the excessive occupation of medical resources. 12 The importance of the ED in providing platform support and technology leadership for the health-care system in China is becoming increasingly prominent. 13 However, with the increase in patients attending EDs annually, triage has become a key link in emergency treatment; but it is a time-consuming and labor-intensive task. In addition, there is no standard emergency triage system in China. 14–17 Implementing safe and effective triage is of great importance to accurately identifying emergency patients and those with severe diseases, guaranteeing their safety and improving emergency diagnoses and treatment efficiency. 18–20 At present -Abstract Truncated-
health care sciences & services,health policy & services