DRGs and managing health care economics, Part II: A symposium. Employee health cost management: information and analysis at the level of the firm.

D. Lairson,J. Herd,N. Frye

Abstract:

What problem does this paper attempt to address?

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Hao Ding,Xue Feng,Qi Yang,Yunmei Yang,Siyi Zhu,Xiaozhen Ji,Y. James Kang,Jichuan Shen,Ming Zhao,Shuchang Xu,Gangmin Ning,Yuheng Xu

DOI: https://doi.org/10.21203/rs.3.rs-3327850/v1

2023-01-01

Abstract:Abstract Background To analyze the risk factors associated with intubated critically ill patients in the emergency department (ED) and develop a prediction model by machine learning (ML) algorithms. Methods This study was conducted in an academic tertiary hospital in Hangzhou, China. Critical ill patients admitted to the ED were retrospectively analyzed from May 2018 to July 2022. The demographic characteristics, distribution of organ dysfunction, parameters for different organs’ examination, and status of mechanical ventilation were recorded. These patients were assigned to the positive and negative groups according to ventilation support. We used the eXtreme Gradient Boosting (XGBoost) algorithm to develop the prediction model and compared it with other algorithms, such as logistic regression (LR), artificial neural network (ANN), and random forest (RF). SHapley Additive exPlanations (SHAP) was used to analyze the risk factors of intubated critically ill patients in the ED. Then, the best performance of the predictive model was used for auxiliary diagnosis. Results Of 14,589 critically ill patients, 10212 comprised the training group and 4377 comprised the test group; 2289 intubated patients were obtained from the electronic medical records. The mean age, the mean scores of vital signs, the parameters of different organs, and blood oxygen examination results differed significantly between the two groups ( p < 0.05). The white blood cell count, international normalized ratio, respiratory rate, and pH are the top four risk factors for intubation in critically ill patients. Based on the risk factors in different predictive models, the XGBoost model showed the highest AUROC (0.8353) for predicting ED intubation. Conclusions For critically ill patients in the ED, the proposed model can predict potential intubation based on the risk factors in the clinically predictive model.
Emergency department disposition prediction using a deep neural network with integrated clinical narratives and structured data

Chien-Hua Chen,Jer-Guang Hsieh,Shu-Ling Cheng,Yih-Lon Lin,Po-Hsiang Lin,Jyh-Horng Jeng

DOI: https://doi.org/10.1016/j.ijmedinf.2020.104146

Abstract:Background: Emergency department (ED) overcrowding has been a serious issue and demands effective clinical decision-making of patient disposition. In previous studies, emergency clinical narratives provide a rich context for clinical decisions. We aimed to develop the disposition prediction model using deep learning modeling strategy with the heterogeneous data, including the physicians' narratives. Methods: We constructed a retrospective cohort of all 104,083 ED visits of non-trauma adults during 2017-18 from an academically affiliated ED in Taiwan. 18,308 visits were excluded based on the completeness of each record and the unpredictable dispositions, such as out-of-hospital cardiac arrest, against-advice discharge, and escapes. We integrated subjective section of the first physicians' clinical narratives and structured data (e.g., demographics, triage vital signs, etc.) as available predictors at the first physician-patient encounter. To predict final patient disposition (i.e., hospitalization or discharge), a deep neural network (DNN) model was developed with word embedding, a common natural language processing method. We compared the proposed model to a reference model using the Rapid Emergency Medicine Score, a logistic regression model with structured data, and a DNN model with paragraph vectors. F1 score was used to measure the predictive performance for each model. Results: The F1 score (with 95 % CI) for the proposed model, the reference model, the logistic regression model with structured data, and the DNN model with paragraph vectors were 0.674 (0.669-0.679), 0.474 (0.469-0.479), 0.547 (0.543-0.551), and 0.602 (0.596-0.607), respectively. While analyzing the relationship between context length and predictive performance under the proposed model, the F1 score at 95th percentile of the word counts was higher than that at 25th percentile of the word counts in chief complaint [0.634 (0.629-0.640) vs. 0.624 (0.620-0.628)] and in present illness [0.671 (0.667-0.674) vs. 0.654 (0.651-0.658)], but not in past medical history [0.674 (0.669-0.679) vs. 0.673 (0.666-0.679)]. Conclusions: The proposed deep learning model with the usage of the first physicians' clinical narratives and structured data based on natural language processing outperformed the commonly used ones in terms of F1 score. It also evidenced the importance of the subjective section of clinical narratives, which serve as vital predictors for ED clinical decision-making.
Emergency department triage prediction of clinical outcomes using machine learning models

Yoshihiko Raita,Tadahiro Goto,Mohammad Kamal Faridi,David F. M. Brown,Carlos A. Camargo,Kohei Hasegawa

DOI: https://doi.org/10.1186/s13054-019-2351-7

IF: 15.1

2019-02-22

Critical Care

Abstract:BackgroundDevelopment of emergency department (ED) triage systems that accurately differentiate and prioritize critically ill from stable patients remains challenging. We used machine learning models to predict clinical outcomes, and then compared their performance with that of a conventional approach—the Emergency Severity Index (ESI).MethodsUsing National Hospital and Ambulatory Medical Care Survey (NHAMCS) ED data, from 2007 through 2015, we identified all adult patients (aged ≥ 18 years). In the randomly sampled training set (70%), using routinely available triage data as predictors (e.g., demographics, triage vital signs, chief complaints, comorbidities), we developed four machine learning models: Lasso regression, random forest, gradient boosted decision tree, and deep neural network. As the reference model, we constructed a logistic regression model using the five-level ESI data. The clinical outcomes were critical care (admission to intensive care unit or in-hospital death) and hospitalization (direct hospital admission or transfer). In the test set (the remaining 30%), we measured the predictive performance, including area under the receiver-operating-characteristics curve (AUC) and net benefit (decision curves) for each model.ResultsOf 135,470 eligible ED visits, 2.1% had critical care outcome and 16.2% had hospitalization outcome. In the critical care outcome prediction, all four machine learning models outperformed the reference model (e.g., AUC, 0.86 [95%CI 0.85–0.87] in the deep neural network vs 0.74 [95%CI 0.72–0.75] in the reference model), with less under-triaged patients in ESI triage levels 3 to 5 (urgent to non-urgent). Likewise, in the hospitalization outcome prediction, all machine learning models outperformed the reference model (e.g., AUC, 0.82 [95%CI 0.82–0.83] in the deep neural network vs 0.69 [95%CI 0.68–0.69] in the reference model) with less over-triages in ESI triage levels 1 to 3 (immediate to urgent). In the decision curve analysis, all machine learning models consistently achieved a greater net benefit—a larger number of appropriate triages considering a trade-off with over-triages—across the range of clinical thresholds.ConclusionsCompared to the conventional approach, the machine learning models demonstrated a superior performance to predict critical care and hospitalization outcomes. The application of modern machine learning models may enhance clinicians’ triage decision making, thereby achieving better clinical care and optimal resource utilization.

critical care medicine
Application of Machine Learning Techniques to Development of Emergency Medical Rapid Triage Prediction Models in Acute Care

Cheng-Han Tsai,Ya-Han Hu

DOI: https://doi.org/10.1097/cin.0000000000001057

2024-01-10

CIN Computers Informatics Nursing

Abstract:Given the critical and complex features of medical emergencies, it is essential to develop models that enable prompt and suitable clinical decision-making based on considerable information. Emergency nurses are responsible for categorizing and prioritizing injuries and illnesses on the frontlines of the emergency room. This study aims to create an Emergency Medical Rapid Triage and Prediction Assistance model using electronic medical records and machine learning techniques. Patient information was retrieved from the emergency department of a large regional teaching hospital in Taiwan, and five supervised learning techniques were used to construct classification models for predicting critical outcomes. Of these models, the model using logistic regression had superior prediction performance, with an F1 score of 0.861 and an area under the receiver operating characteristic curve of 0.855. The Emergency Medical Rapid Triage and Prediction Assistance model demonstrated superior performance in predicting intensive care and hospitalization outcomes compared with the Taiwan Triage and Acuity Scale and three clinical early warning tools. The proposed model has the potential to assist emergency nurses in executing challenging triage assessments and emergency teams in treating critically ill patients promptly, leading to improved clinical care and efficient utilization of medical resources.

nursing,medical informatics,computer science, interdisciplinary applications
Using machine learning tools to predict outcomes for emergency department intensive care unit patients

Qiangrong Zhai,Zi Lin,Hongxia Ge,Yang Liang,Nan Li,Qingbian Ma,Chuyang Ye

DOI: https://doi.org/10.1038/s41598-020-77548-3

IF: 4.6

2020-12-01

Scientific Reports

Abstract:Abstract The number of critically ill patients has increased globally along with the rise in emergency visits. Mortality prediction for critical patients is vital for emergency care, which affects the distribution of emergency resources. Traditional scoring systems are designed for all emergency patients using a classic mathematical method, but risk factors in critically ill patients have complex interactions, so traditional scoring cannot as readily apply to them. As an accurate model for predicting the mortality of emergency department critically ill patients is lacking, this study’s objective was to develop a scoring system using machine learning optimized for the unique case of critical patients in emergency departments. We conducted a retrospective cohort study in a tertiary medical center in Beijing, China. Patients over 16 years old were included if they were alive when they entered the emergency department intensive care unit system from February 2015 and December 2015. Mortality up to 7 days after admission into the emergency department was considered as the primary outcome, and 1624 cases were included to derive the models. Prospective factors included previous diseases, physiologic parameters, and laboratory results. Several machine learning tools were built for 7-day mortality using these factors, for which their predictive accuracy (sensitivity and specificity) was evaluated by area under the curve (AUC). The AUCs were 0.794, 0.840, 0.849 and 0.822 respectively, for the SVM, GBDT, XGBoost and logistic regression model. In comparison with the SAPS 3 model (AUC = 0.826), the discriminatory capability of the newer machine learning methods, XGBoost in particular, is demonstrated to be more reliable for predicting outcomes for emergency department intensive care unit patients.

multidisciplinary sciences
A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Ting-Yun Huang,Chee-Fah Chong,Heng-Yu Lin,Tzu-Ying Chen,Yung-Chun Chang,Ming-Chin Lin

DOI: https://doi.org/10.1016/j.ijmedinf.2024.105564

Abstract:Introduction: The urgency and complexity of emergency room (ER) settings require precise and swift decision-making processes for patient care. Ensuring the timely execution of critical examinations and interventions is vital for reducing diagnostic errors, but the literature highlights a need for innovative approaches to optimize diagnostic accuracy and patient outcomes. In response, our study endeavors to create predictive models for timely examinations and interventions by leveraging the patient's symptoms and vital signs recorded during triage, and in so doing, augment traditional diagnostic methodologies. Methods: Focusing on four key areas-medication dispensing, vital interventions, laboratory testing, and emergency radiology exams, the study employed Natural Language Processing (NLP) and seven advanced machine learning techniques. The research was centered around the innovative use of BioClinicalBERT, a state-of-the-art NLP framework. Results: BioClinicalBERT emerged as the superior model, outperforming others in predictive accuracy. The integration of physiological data with patient narrative symptoms demonstrated greater effectiveness compared to models based solely on textual data. The robustness of our approach was confirmed by an Area Under the Receiver Operating Characteristic curve (AUROC) score of 0.9. Conclusion: The findings of our study underscore the feasibility of establishing a decision support system for emergency patients, targeting timely interventions and examinations based on a nuanced analysis of symptoms. By using an advanced natural language processing technique, our approach shows promise for enhancing diagnostic accuracy. However, the current model is not yet fully mature for direct implementation into daily clinical practice. Recognizing the imperative nature of precision in the ER environment, future research endeavors must focus on refining and expanding predictive models to include detailed timely examinations and interventions. Although the progress achieved in this study represents an encouraging step towards a more innovative and technology-driven paradigm in emergency care, full clinical integration warrants further exploration and validation.
Machine Learning and Initial Nursing Assessment-Based Triage System for Emergency Department

Jae Yong Yu,Gab Yong Jeong,Ok Soon Jeong,Dong Kyung Chang,Won Chul Cha

DOI: https://doi.org/10.4258/hir.2020.26.1.13

2020-01-01

Healthcare Informatics Research

Abstract:OBJECTIVES: The aim of this study was to develop machine learning (ML) and initial nursing assessment (INA)-based emergency department (ED) triage to predict adverse clinical outcome.METHODS: The retrospective study included ED visits between January 2016 and December 2017 that resulted in either intensive care unit admission or emergency room death. We trained four classifiers using logistic regression and a deep learning model on INA and low dimensional (LD) INA, logistic regression on the Korea Triage and acuity scale (KTAS) and Sequential Related Organ Failure Assessment (SOFA). We varied the outcome ratio for external validation. Finally, variables of importance were identified using the random forest model's information gain. The four most influential variables were used for LD modeling for efficiency.RESULTS: A total of 86,304 patient visits were included, with an overall outcome rate of 3.5%. The area under the curve (AUC) values for the KTAS model were 76.8 (74.9-78.6) with logistic regression and 74.0 (72.1-75.9) for the SOFA model, while the AUC values of the INA model were 87.2 (85.9-88.6) and 87.6 (86.3-88.9) with logistic regression and deep learning, suggesting that the ML and INA-based triage system result more accurately predicted the outcomes. The AUC values for the LD model were 81.2 (79.4-82.9) and 80.7 (78.9-82.5) for logistic regression and deep learning, respectively.CONCLUSIONS: We developed an ML and INA-based triage system for EDs. The novel system was able to predict clinical outcomes more accurately than existing triage systems, KTAS and SOFA.
A novel deep learning algorithm for real-time prediction of clinical deterioration in the emergency department for a multimodal clinical decision support system

Arom Choi,Kwanhyung Lee,Heejung Hyun,Kwang Joon Kim,Byungeun Ahn,Kyung Hyun Lee,Sangchul Hahn,So Yeon Choi,Ji Hoon Kim

DOI: https://doi.org/10.1038/s41598-024-80268-7

IF: 4.6

2024-12-04

Scientific Reports

Abstract:The array of complex and evolving patient data has limited clinical decision making in the emergency department (ED). This study introduces an advanced deep learning algorithm designed to enhance real-time prediction accuracy for integration into a novel Clinical Decision Support System (CDSS). A retrospective study was conducted using data from a level 1 tertiary hospital. The algorithm's predictive performance was evaluated based on in-hospital cardiac arrest, inotropic circulatory support, advanced airway, and intensive care unit admission. We developed an artificial intelligence (AI) algorithm for CDSS that integrates multiple data modalities, including vitals, laboratory, and imaging results from electronic health records. The AI model was trained and tested on a dataset of 237,059 ED visits. The algorithm's predictions, based solely on triage information, significantly outperformed traditional logistic regression models, with notable improvements in the area under the precision-recall curve (AUPRC). Additionally, predictive accuracy improved with the inclusion of continuous data input at shorter intervals. This study suggests the feasibility of using AI algorithms in diverse clinical scenarios, particularly for earlier detection of clinical deterioration. Future work should focus on expanding the dataset and enhancing real-time data integration across multiple centers to further optimize its application within the novel CDSS.

multidisciplinary sciences
Machine Learning-Based Prediction of Clinical Outcomes for Children During Emergency Department Triage

Tadahiro Goto,Carlos A Camargo Jr,Mohammad Kamal Faridi,Robert J Freishtat,Kohei Hasegawa

DOI: https://doi.org/10.1001/jamanetworkopen.2018.6937

2019-01-04

Abstract:Importance: While machine learning approaches may enhance prediction ability, little is known about their utility in emergency department (ED) triage. Objectives: To examine the performance of machine learning approaches to predict clinical outcomes and disposition in children in the ED and to compare their performance with conventional triage approaches. Design, setting, and participants: Prognostic study of ED data from the National Hospital Ambulatory Medical Care Survey from January 1, 2007, through December 31, 2015. A nationally representative sample of 52 037 children aged 18 years or younger who presented to the ED were included. Data analysis was performed in August 2018. Main outcomes and measures: The outcomes were critical care (admission to an intensive care unit and/or in-hospital death) and hospitalization (direct hospital admission or transfer). In the training set (70% random sample), using routinely available triage data as predictors (eg, demographic characteristics and vital signs), we derived 4 machine learning-based models: lasso regression, random forest, gradient-boosted decision tree, and deep neural network. In the test set (the remaining 30% of the sample), we measured the models' prediction performance by computing C statistics, prospective prediction results, and decision curves. These machine learning models were built for each outcome and compared with the reference model using the conventional triage classification information. Results: Of 52 037 eligible ED visits by children (median [interquartile range] age, 6 [2-14] years; 24 929 [48.0%] female), 163 (0.3%) had the critical care outcome and 2352 (4.5%) had the hospitalization outcome. For the critical care prediction, all machine learning approaches had higher discriminative ability compared with the reference model, although the difference was not statistically significant (eg, C statistics of 0.85 [95% CI, 0.78-0.92] for the deep neural network vs 0.78 [95% CI, 0.71-0.85] for the reference; P = .16), and lower number of undertriaged critically ill children in the conventional triage levels 3 to 5 (urgent to nonurgent). For the hospitalization prediction, all machine learning approaches had significantly higher discrimination ability (eg, C statistic, 0.80 [95% CI, 0.78-0.81] for the deep neural network vs 0.73 [95% CI, 0.71-0.75] for the reference; P < .001) and fewer overtriaged children who did not require inpatient management in the conventional triage levels 1 to 3 (immediate to urgent). The decision curve analysis demonstrated a greater net benefit of machine learning models over ranges of clinical thresholds. Conclusions and relevance: Machine learning-based triage had better discrimination ability to predict clinical outcomes and disposition, with reduction in undertriaging critically ill children and overtriaging children who are less ill.
Interpretable Deep Learning System for Identifying Critical Patients Through the Prediction of Triage Level, Hospitalization, and Length of Stay: Prospective Study

Yu-Ting Lin,Yuan-Xiang Deng,Chu-Lin Tsai,Chien-Hua Huang,Li-Chen Fu

DOI: https://doi.org/10.2196/48862

2024-04-01

Abstract:Background: Triage is the process of accurately assessing patients' symptoms and providing them with proper clinical treatment in the emergency department (ED). While many countries have developed their triage process to stratify patients' clinical severity and thus distribute medical resources, there are still some limitations of the current triage process. Since the triage level is mainly identified by experienced nurses based on a mix of subjective and objective criteria, mis-triage often occurs in the ED. It can not only cause adverse effects on patients, but also impose an undue burden on the health care delivery system. Objective: Our study aimed to design a prediction system based on triage information, including demographics, vital signs, and chief complaints. The proposed system can not only handle heterogeneous data, including tabular data and free-text data, but also provide interpretability for better acceptance by the ED staff in the hospital. Methods: In this study, we proposed a system comprising 3 subsystems, with each of them handling a single task, including triage level prediction, hospitalization prediction, and length of stay prediction. We used a large amount of retrospective data to pretrain the model, and then, we fine-tuned the model on a prospective data set with a golden label. The proposed deep learning framework was built with TabNet and MacBERT (Chinese version of bidirectional encoder representations from transformers [BERT]). Results: The performance of our proposed model was evaluated on data collected from the National Taiwan University Hospital (901 patients were included). The model achieved promising results on the collected data set, with accuracy values of 63%, 82%, and 71% for triage level prediction, hospitalization prediction, and length of stay prediction, respectively. Conclusions: Our system improved the prediction of 3 different medical outcomes when compared with other machine learning methods. With the pretrained vital sign encoder and repretrained mask language modeling MacBERT encoder, our multimodality model can provide a deeper insight into the characteristics of electronic health records. Additionally, by providing interpretability, we believe that the proposed system can assist nursing staff and physicians in taking appropriate medical decisions.
Prediction of Cardiac Arrest in the Emergency Department Based on Machine Learning and Sequential Characteristics: Model Development and Retrospective Clinical Validation Study

Sungjun Hong,Sungjoo Lee,Jeonghoon Lee,Won Chul Cha,Kyunga Kim

DOI: https://doi.org/10.2196/15932

IF: 3.2

2020-08-04

JMIR Medical Informatics

Abstract:Background The development and application of clinical prediction models using machine learning in clinical decision support systems is attracting increasing attention. Objective The aims of this study were to develop a prediction model for cardiac arrest in the emergency department (ED) using machine learning and sequential characteristics and to validate its clinical usefulness. Methods This retrospective study was conducted with ED patients at a tertiary academic hospital who suffered cardiac arrest. To resolve the class imbalance problem, sampling was performed using propensity score matching. The data set was chronologically allocated to a development cohort (years 2013 to 2016) and a validation cohort (year 2017). We trained three machine learning algorithms with repeated 10-fold cross-validation. Results The main performance parameters were the area under the receiver operating characteristic curve (AUROC) and the area under the precision-recall curve (AUPRC). The random forest algorithm (AUROC 0.97; AUPRC 0.86) outperformed the recurrent neural network (AUROC 0.95; AUPRC 0.82) and the logistic regression algorithm (AUROC 0.92; AUPRC=0.72). The performance of the model was maintained over time, with the AUROC remaining at least 80% across the monitored time points during the 24 hours before event occurrence. Conclusions We developed a prediction model of cardiac arrest in the ED using machine learning and sequential characteristics. The model was validated for clinical usefulness by chronological visualization focused on clinical usability.

medical informatics
Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram

Po-Cheng Chang,Zhi-Yong Liu,Yu-Chang Huang,Yu-Chun Hsu,Jung-Sheng Chen,Ching-Heng Lin,Richard Tsai,Chung-Chuan Chou,Ming-Shien Wen,Hung-Ta Wo,Wen-Chen Lee,Hao-Tien Liu,Chun-Chieh Wang,Chang-Fu Kuo

DOI: https://doi.org/10.3389/fcvm.2023.1245614

IF: 3.6

2023-10-28

Frontiers in Cardiovascular Medicine

Abstract:Background: The risk of mortality is relatively high among patients who visit the emergency department (ED), and stratifying patients at high risk can help improve medical care. This study aimed to create a machine-learning model that utilizes the standard 12-lead ECG to forecast acute mortality risk in ED patients. Methods: The database included patients who visited the EDs and underwent standard 12-lead ECG between October 2007 and December 2017. A convolutional neural network (CNN) ECG model was developed to classify survival and mortality using 12-lead ECG tracings acquired from 345,593 ED patients. For machine learning model development, the patients were randomly divided into training, validation and testing datasets. The performance of the mortality risk prediction in this model was evaluated for various causes of death. Results: Patients who visited the ED and underwent one or more ECG examinations experienced a high incidence of 30-day mortality [18,734 (5.42%)]. The developed CNN model demonstrated high accuracy in predicting acute mortality (hazard ratio 8.50, 95% confidence interval 8.20–8.80) with areas under the receiver operating characteristic (ROC) curve of 0.84 for the 30-day mortality risk prediction models. This CNN model also demonstrated good performance in predicting one-year mortality (hazard ratio 3.34, 95% confidence interval 3.30–3.39). This model exhibited good predictive performance for 30-day mortality not only for cardiovascular diseases but also across various diseases. Conclusions: The machine learning-based ECG model utilizing CNN screens the risks for 30-day mortality. This model can complement traditional early warning scoring indexes as a useful screening tool for mortality prediction.

cardiac & cardiovascular systems
Machine learning-based prediction of critical illness in children visiting the emergency department

Soyun Hwang,Bongjin Lee

DOI: https://doi.org/10.1371/journal.pone.0264184

IF: 3.7

2022-02-17

PLoS ONE

Abstract:Objectives Triage is an essential emergency department (ED) process designed to provide timely management depending on acuity and severity; however, the process may be inconsistent with clinical and hospitalization outcomes. Therefore, studies have attempted to augment this process with machine learning models, showing advantages in predicting critical conditions and hospitalization outcomes. The aim of this study was to utilize nationwide registry data to develop a machine learning-based classification model to predict the clinical course of pediatric ED visits. Methods This cross-sectional observational study used data from the National Emergency Department Information System on emergency visits of children under 15 years of age from January 1, 2016, to December 31, 2017. The primary and secondary outcomes were to identify critically ill children and predict hospitalization from triage data, respectively. We developed and tested a random forest model with the under sampled dataset and validated the model using the entire dataset. We compared the model’s performance with that of the conventional triage system. Results A total of 2,621,710 children were eligible for the analysis and included 12,951 (0.5%) critical outcomes and 303,808 (11.6%) hospitalizations. After validation, the area under the receiver operating characteristic curve was 0.991 (95% confidence interval [CI] 0.991–0.992) for critical outcomes and 0.943 (95% CI 0.943–0.944) for hospitalization, which were higher than those of the conventional triage system. Conclusions The machine learning-based model using structured triage data from a nationwide database can effectively predict critical illness and hospitalizations among children visiting the ED.

multidisciplinary sciences
Using a clinical narrative-aware pre-trained language model for predicting emergency department patient disposition and unscheduled return visits

Tzu-Ying Chen,Ting-Yun Huang,Yung-Chun Chang

DOI: https://doi.org/10.1016/j.jbi.2024.104657

Abstract:The increasing prevalence of overcrowding in Emergency Departments (EDs) threatens the effective delivery of urgent healthcare. Mitigation strategies include the deployment of monitoring systems capable of tracking and managing patient disposition to facilitate appropriate and timely care, which subsequently reduces patient revisits, optimizes resource allocation, and enhances patient outcomes. This study used ∼ 250,000 emergency department visit records from Taipei Medical University-Shuang Ho Hospital to develop a natural language processing model using BlueBERT, a biomedical domain-specific pre-trained language model, to predict patient disposition status and unplanned readmissions. Data preprocessing and the integration of both structured and unstructured data were central to our approach. Compared to other models, BlueBERT outperformed due to its pre-training on a diverse range of medical literature, enabling it to better comprehend the specialized terminology, relationships, and context present in ED data. We found that translating Chinese-English clinical narratives into English and textualizing numerical data into categorical representations significantly improved the prediction of patient disposition (AUROC = 0.9014) and 72-hour unscheduled return visits (AUROC = 0.6475). The study concludes that the BlueBERT-based model demonstrated superior prediction capabilities, surpassing the performance of prior patient disposition predictive models, thus offering promising applications in the realm of ED clinical practice.
The development and validation of a novel deep-learning algorithm to predict in-hospital cardiac arrest in ED-ICU (emergency department-based intensive care units): a single center retrospective cohort study

DOI: https://doi.org/10.22514/sv.2024.045

2024-01-01

Signa Vitae

Abstract:Over recent years, the escalation of patient volumes in emergency departments (ED) worldwide has posed to the delivery of timely critical care. Intensive Care Unit (ICU) services became essential due to increasing acuity in EDs, and previous studies revealed a strong association between prolonged boarding times and unfavorable outcomes. Innovative strategies such as Emergency Department-based Intensive Care Units (ED-ICUs) have been introduced to optimize critical care delivery. Given the higher acuity and mortality rates in ED-ICU patients, the prediction of certain events, such as In-Hospital Cardiac Arrest (IHCA), has become abstruse. Conventional Early Warning Scores (EWSs) were developed to stratify the risk of conventional ICUs, but have never been validated in ED-ICU patients with higher acuity. Moreover, EWSs are predominantly focused on forecasting mortality and lack capability for real-time prediction. Our study aimed to develop and validate a deep-learning-based model to predict IHCA within 24 h in ED-ICU. We included 1975 patients admitted to ED-ICU. The study period was from 01 January 2019 to 31 December 2020. Our model, the Deep-ICU CMS (Central Monitoring System), uses four classic vital signs (blood pressure, heart rate, respiratory rate, and body temperature) as input. The model outperformed conventional EWSs in predicting IHCA and maintained performance even with extended prediction windows; it provided robust prediction within a 24-h window, setting it apart from models with restricted prediction horizons. It achieved notably high sensitivity and specificity, overcoming the alarm fatigue issue that is common in EWSs. This study pioneered IHCA risk stratification in ED-ICU and showcases Deep-ICU CMS as a robust prediction tool that overcomes the limitations of conventional EWSs. Prospective and external validation are now warranted to confirm the impact of Deep-ICU CMS in real-world practice. Given the scarcity of research in ED-ICU, our findings contribute valuable insights to optimizing critical care delivery.

emergency medicine
Patient stratification based on the risk of severe illness in emergency departments through collaborative machine learning models

Jui-Ying Chen,Chih-Chia Hsieh,Jung-Ting Lee,Chih-Hao Lin,Chung-Yao Kao

DOI: https://doi.org/10.1016/j.ajem.2024.06.015

Abstract:Objectives: Emergency department (ED) overcrowding presents a global challenge that inhibits prompt care for critically ill patients. Traditional 5-level triage system that heavily rely on the judgment of the triage staff could fail to detect subtle symptoms in critical patients, thus leading to delayed treatment. Unlike previous rivalry-focused approaches, our study aimed to establish a collaborative machine learning (ML) model that renders risk scores for severe illness, which may assist the triage staff to provide a better patient stratification for timely critical cares. Methods: This retrospective study was conducted at a tertiary teaching hospital. Data were collected from January 2015 to October 2022. Demographic and clinical information were collected at triage. The study focused on severe illness as the outcome. We developed artificial neural network (ANN) models, with or without utilizing the Taiwan Triage and Acuity Scale (TTAS) score as one of the predictors. The model using the TTAS score is termed a machine-human collaborative model (ANN-MH), while the model without it is referred to as a machine-only model (ANN-MO). The predictive power of these models was assessed using the area under the receiver-operating-characteristic (AUROC) and the precision-recall curves (AUPRC); their sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1 score were compared. Results: The study analyzed 668,602 ED visits from 2015 to 2022. Among them, 278,724 visits from 2015 to 2018 were used for model training and validation, while 320,201 visits from 2019 to 2022 were for testing model performance. Approximately 2.6% of visits were by severely ill patients, whose TTAS scores ranged from 1 to 5. The ANN-MH model achieved a testing AUROC of 0.918 and AUPRC of 0.369, while for the ANN-MO model the AUROC and AUPRC were 0.909 and 0.339, respectively. Based on these metrics, the ANN-MH model outperformed the ANN-MO model, and both surpassed human triage classification. Subgroup analyses further highlighted the models' capability to identify higher-risk patients within the same triage level. Conclusions: The traditional 5-level triage system often falls short, leading to under-triage of critical patients. Our models include a score-based differentiation within a triage level to offer advanced risk stratification, thereby promoting patient safety.
Prevention of NF-kappaB activation in vivo by a cell-permeable NF-kappaB inhibitor peptide.

A. Mora,J. LaVoy,M. McKean,A. Stecenko,K. Brigham,R. Parker,M. Rojas

Abstract:The NF-kappaB/Rel transcription factor family plays a central role in coordinating the expression of a variety of genes that regulate stress responses, immune cell activation, apoptosis, proliferation, differentiation, and oncogenic transformation. Interventions that target the NF-kappaB pathway may be therapeutic for a variety of pathologies, especially immune/inflammatory diseases. Using membrane translocating sequence (MTS) technology, we developed a cell-permeable dominant inhibitor of NF-kappaB activation, termed IkappaBalpha-(DeltaN)-MTS. This molecule contains a 12-amino acid MTS motif attached to the COOH-terminal region of a nondegradable inhibitor protein [IkappaBalpha-(DeltaN)]. The recombinant protein enters cells and localizes in the cytoplasm. Delivery of the IkappaBalpha-(DeltaN)-MTS to cell lines and primary cells inhibited nuclear translocation of NF-kappaB proteins induced by cell activation. The protein also effectively inhibited NF-kappaB activation in vivo in two different animal models: NF-kappaB activation in response to skin wounding in mice and NF-kappaB activation in lungs after endotoxin treatment in sheep. Inhibition of NF-kappaB by the IkappaBalpha-(DeltaN)-MTS in the endotoxin model attenuated physiological responses to endotoxemia. These data demonstrate that activation of NF-kappaB can be inhibited using a recombinant protein designed to penetrate into cells. This technology may provide a new approach to NF-kappaB pathway-targeted therapies.
Artificial intelligence algorithm to predict the need for critical care in prehospital emergency medical services

Da-Young Kang,Kyung-Jae Cho,Oyeon Kwon,Joon-myoung Kwon,Ki-Hyun Jeon,Hyunho Park,Yeha Lee,Jinsik Park,Byung-Hee Oh

DOI: https://doi.org/10.1186/s13049-020-0713-4

2020-03-04

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine

Abstract:Abstract Background In emergency medical services (EMSs), accurately predicting the severity of a patient’s medical condition is important for the early identification of those who are vulnerable and at high-risk. In this study, we developed and validated an artificial intelligence (AI) algorithm based on deep learning to predict the need for critical care during EMS. Methods We conducted a retrospective observation cohort study. The algorithm was established using development data from the Korean national emergency department information system, which were collected during visits in real time from 151 emergency departments (EDs). We validated the algorithm using EMS run sheets from two EDs. The study subjects comprised adult patients who visited EDs. The endpoint was critical care, and we used age, sex, chief complaint, symptom onset to arrival time, trauma, and initial vital signs as the predicted variables. Results The number of patients in the development data was 8,981,181, and the validation data comprised 2604 EMS run sheets from two hospitals. The area under the receiver operating characteristic curve of the algorithm to predict the critical care was 0.867 (95% confidence interval, [0.864–0.871]). This result outperformed the Emergency Severity Index (0.839 [0.831–0.846]), Korean Triage and Acuity System (0.824 [0.815–0.832]), National Early Warning Score (0.741 [0.734–0.748]), and Modified Early Warning Score (0.696 [0.691–0.699]). Conclusions The AI algorithm accurately predicted the need for the critical care of patients using information during EMS and outperformed the conventional triage tools and early warning scores.
Prediction of Mortality Events of Patients with Acute Heart Failure in Intensive Care Unit Based on Deep Neural Network

Jicheng Huang,Yufeng Cai,Xusheng Wu,Xin Huang,Jianwei Liu,Dehua Hu

DOI: https://doi.org/10.1016/j.cmpb.2024.108403

IF: 6.1

2024-09-03

Computer Methods and Programs in Biomedicine

Abstract:Background : Acute heart failure (AHF) in the intensive care unit (ICU) is characterized by its criticality, rapid progression, complex and changeable condition, and its pathophysiological process involves the interaction of multiple organs and systems. This makes it difficult to predict in-hospital mortality events comprehensively and accurately. Traditional analysis methods based on statistics and machine learning suffer from insufficient model performance, poor accuracy caused by prior dependence, and difficulty in adequately considering the complex relationships between multiple risk factors. Therefore, the application of deep neural network (DNN) techniques to the specific scenario, predicting mortality events of patients with AHF under intensive care, has become a research frontier. Methods : This research utilized the MIMIC-IV critical care database as the primary data source and employed the synthetic minority over-sampling technique (SMOTE) to balance the dataset. Deep neural network models—backpropagation neural network (BPNN) and recurrent neural network (RNN), which are based on electronic medical record data mining, were employed to investigate the in-hospital death event judgment task of patients with AHF under intensive care. Additionally, multiple single machine learning models and ensemble learning models were constructed for comparative experiments. Moreover, we achieved various optimal performance combinations by modifying the classification threshold of deep neural network models to address the diverse real-world requirements in the ICU. Finally, we conducted an interpretable deep model using SHapley Additive exPlanations (SHAP) to uncover the most influential medical record features for each patient from the aspects of global and local interpretation. Results : In terms of model performance in this scenario, deep neural network models outperform both single machine learning models and ensemble learning models, achieving the highest Accuracy, Precision, Recall, F1 value, and Area under the ROC curve, which can reach 0.949, 0.925, 0.983, 0.953, and 0.987 respectively. SHAP value analysis revealed that the ICU scores (APSIII, OASIS, SOFA) are significantly correlated with the occurrence of in-hospital fatal events. Conclusions : Our study underscores that DNN-based mortality event classifier offers a novel intelligent approach for forecasting and assessing the prognosis of AHF patients in the ICU. Additionally, the ICU scores stand out as the most predictive features, which implies that in the decision-making process of the models, ICU scores can provide the most crucial information, making the greatest positive or negative contribution to influence the incidence of in-hospital mortality among patients with acute heart failure.

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods
Nursing notes-aware deep neural network for predicting mortality risk after hospital discharge

Yong-Zhen Huang,Yan-Ming Chen,Chih-Cheng Lin,Hsiao-Yean Chiu,Yung-Chun Chang

DOI: https://doi.org/10.1016/j.ijnurstu.2024.104797

IF: 8.1

2024-05-10

International Journal of Nursing Studies

Abstract:Background ICU readmissions and post-discharge mortality pose significant challenges. Previous studies used EHRs and machine learning models, but mostly focused on structured data. Nursing records contain crucial unstructured information, but their utilization is challenging. Natural Language Processing (NLP) can extract structured features from clinical text. This study proposes the Crucial Nursing Description Extractor (CNDE) to predict post-ICU discharge mortality rates and identify high-risk patients for unplanned readmission by analyzing electronic nursing records. Objective Developed a deep neural network (NurnaNet) with the ability to perceive nursing records, combined with a bio-clinical medicine pre-trained language model (BioClinicalBERT) to analyze the electronic health records (EHR) in the MIMIC III data set to predict the death of patients within six months and two years risk. Design A cohort and system development design was used. Setting(s) Based on data extracted from MIMIC-III, a database of critically ill in the US between 2001 and 2012, the results were analyzed. Participants We calculated patients' age using admission time and date of birth information from the MIMIC dataset. Patients under 18 or over 89 years old, or who died in the hospital, were excluded. We analyzed 16,973 nursing records from patients' ICU stays. Methods We have developed a technology called the Crucial Nursing Description Extractor (CNDE), which extracts key content from text. We use logarithmic likelihood ratio to extract keywords and combine BioClinicalBERT. We predict the survival of discharged patients after six months and two years and evaluate the performance of the model using precision, recall, F 1 -score, receiver operating characteristic curve (ROC curve), area under curve (AUC), and precision-recall curve (PR Curve). Results The research findings indicate that NurnaNet achieved good F 1 -scores (0.67030, 0.70874) within six months and two years. Compared to using BioClinicalBERT alone, there was an improvement in performance of 2.05 % and 1.08 % for predictions within six months and two years, respectively. Conclusions CNDE can effectively reduce long-form records and extract key content. NurnaNet has good F 1 -score in analyzing the data of nursing records, which helps to identify the risk of death of patients after leaving the hospital and adjust the regular follow-up and treatment plan of relevant medical care as soon as possible.

nursing

DRGs and managing health care economics, Part II: A symposium. Employee health cost management: information and analysis at the level of the firm.

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Emergency department disposition prediction using a deep neural network with integrated clinical narratives and structured data

Emergency department triage prediction of clinical outcomes using machine learning models

Application of Machine Learning Techniques to Development of Emergency Medical Rapid Triage Prediction Models in Acute Care

Using machine learning tools to predict outcomes for emergency department intensive care unit patients

A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Machine Learning and Initial Nursing Assessment-Based Triage System for Emergency Department

A novel deep learning algorithm for real-time prediction of clinical deterioration in the emergency department for a multimodal clinical decision support system

Machine Learning-Based Prediction of Clinical Outcomes for Children During Emergency Department Triage

Interpretable Deep Learning System for Identifying Critical Patients Through the Prediction of Triage Level, Hospitalization, and Length of Stay: Prospective Study

Prediction of Cardiac Arrest in the Emergency Department Based on Machine Learning and Sequential Characteristics: Model Development and Retrospective Clinical Validation Study

Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram

Machine learning-based prediction of critical illness in children visiting the emergency department

Using a clinical narrative-aware pre-trained language model for predicting emergency department patient disposition and unscheduled return visits

The development and validation of a novel deep-learning algorithm to predict in-hospital cardiac arrest in ED-ICU (emergency department-based intensive care units): a single center retrospective cohort study

Patient stratification based on the risk of severe illness in emergency departments through collaborative machine learning models

Prevention of NF-kappaB activation in vivo by a cell-permeable NF-kappaB inhibitor peptide.

Artificial intelligence algorithm to predict the need for critical care in prehospital emergency medical services

Prediction of Mortality Events of Patients with Acute Heart Failure in Intensive Care Unit Based on Deep Neural Network

Nursing notes-aware deep neural network for predicting mortality risk after hospital discharge