Abstract:Background: Emergency department (ED) overcrowding is a concerning global health care issue, which is mainly caused by the uncertainty of patient arrivals, especially during the pandemic. Accurate forecasting of patient arrivals can allow health resource allocation in advance to reduce overcrowding. Currently, traditional data, such as historical patient visits, weather, holiday, and calendar, are primarily used to create forecasting models. However, data from an internet search engine (eg, Google) is less studied, although they can provide pivotal real-time surveillance information. The internet data can be employed to improve forecasting performance and provide early warning, especially during the epidemic. Moreover, possible nonlinearities between patient arrivals and these variables are often ignored. Objective: This study aims to develop an intelligent forecasting system with machine learning models and internet search index to provide an accurate prediction of ED patient arrivals, to verify the effectiveness of the internet search index, and to explore whether nonlinear models can improve the forecasting accuracy. Methods: Data on ED patient arrivals were collected from July 12, 2009, to June 27, 2010, the period of the 2009 H1N1 pandemic. These included 139,910 ED visits in our collaborative hospital, which is one of the biggest public hospitals in Hong Kong. Traditional data were also collected during the same period. The internet search index was generated from 268 search queries on Google to comprehensively capture the information about potential patients. The relationship between the index and patient arrivals was verified by Pearson correlation coefficient, Johansen cointegration, and Granger causality. Linear and nonlinear models were then developed with the internet search index to predict patient arrivals. The accuracy and robustness were also examined. Results: All models could accurately predict patient arrivals. The causality test indicated internet search index as a strong predictor of ED patient arrivals. With the internet search index, the mean absolute percentage error (MAPE) and the root mean square error (RMSE) of the linear model reduced from 5.3% to 5.0% and from 24.44 to 23.18, respectively, whereas the MAPE and RMSE of the nonlinear model decreased even more, from 3.5% to 3% and from 16.72 to 14.55, respectively. Compared with each other, the experimental results revealed that the forecasting system with extreme learning machine, as well as the internet search index, had the best performance in both forecasting accuracy and robustness analysis. Conclusions: The proposed forecasting system can make accurate, real-time prediction of ED patient arrivals. Compared with the static traditional variables, the internet search index significantly improves forecasting as a reliable predictor monitoring continuous behavior trend and sudden changes during the epidemic ( P =.002). The nonlinear model performs better than the linear counterparts by capturing the dynamic relationship between the index and patient arrivals. Thus, the system can facilitate staff planning and workflow monitoring.

Machine learning models for predicting unscheduled return visits of patients with abdominal pain at emergency department and validation during COVID-19 pandemic: A retrospective cohort study

Machine learning models for predicting unscheduled return visits to an emergency department: a scoping review

Predicting Unscheduled Emergency Department Return Visits Among Older Adults: Population-Based Retrospective Study

Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions

A Risk Prediction Model for Efficient Intubation in the Emergency Department: A Five-Year Single-Center Retrospective Analysis

Prediction of high-risk emergency department revisits from a machine-learning algorithm: a proof-of-concept study

Advancing Emergency Department Triage Prediction With Machine Learning to Optimize Triage for Abdominal Pain Surgery Patients

Evaluation of unplanned reattendances to the pediatric emergency department – a five-year study

Impact analysis and predictive modeling in emergency care： Evaluating the effects of immediately post-COVID-19 lockdown at a top Chinese teaching hospital

A Comparison of Univariate and Multivariate Forecasting Models Predicting Emergency Department Patient Arrivals during the COVID-19 Pandemic

Acute myocardial infarction risk prediction in emergency chest pain patients: An external validation study

Machine Learning Methods for Predicting Patient-Level Emergency Department Workload

Risk Factors and Predictive Modeling for Post-Acute Sequelae of SARS-CoV-2 Infection: Findings from EHR Cohorts of the RECOVER Initiative.

Interpretable Machine Learning Models for Predicting Critical Outcomes in Patients with Suspected Urinary Tract Infection with Positive Urine Culture

Accurate Forecasting of Emergency Department Arrivals With Internet Search Index and Machine Learning Models: Model Development and Performance Evaluation

Clinical narrative-aware deep neural network for emergency department critical outcome prediction

Trends in visits, imaging, and diagnosis for emergency department abdominal pain presentations in the United States, 2007–2019

Enhancing Emergency Department Management: A Data-Driven Approach to Detect and Predict Surge Persistence

Prediction of COVID-19 Patients' Emergency Room Revisit using Multi-Source Transfer Learning

Using machine learning tools to predict outcomes for emergency department intensive care unit patients

Characteristics and outcomes of patients with COVID-19 who return to the emergency department: a multicentre observational study by the Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN)