Abstract:Background: Emergency department (ED) overcrowding is a concerning global health care issue, which is mainly caused by the uncertainty of patient arrivals, especially during the pandemic. Accurate forecasting of patient arrivals can allow health resource allocation in advance to reduce overcrowding. Currently, traditional data, such as historical patient visits, weather, holiday, and calendar, are primarily used to create forecasting models. However, data from an internet search engine (eg, Google) is less studied, although they can provide pivotal real-time surveillance information. The internet data can be employed to improve forecasting performance and provide early warning, especially during the epidemic. Moreover, possible nonlinearities between patient arrivals and these variables are often ignored. Objective: This study aims to develop an intelligent forecasting system with machine learning models and internet search index to provide an accurate prediction of ED patient arrivals, to verify the effectiveness of the internet search index, and to explore whether nonlinear models can improve the forecasting accuracy. Methods: Data on ED patient arrivals were collected from July 12, 2009, to June 27, 2010, the period of the 2009 H1N1 pandemic. These included 139,910 ED visits in our collaborative hospital, which is one of the biggest public hospitals in Hong Kong. Traditional data were also collected during the same period. The internet search index was generated from 268 search queries on Google to comprehensively capture the information about potential patients. The relationship between the index and patient arrivals was verified by Pearson correlation coefficient, Johansen cointegration, and Granger causality. Linear and nonlinear models were then developed with the internet search index to predict patient arrivals. The accuracy and robustness were also examined. Results: All models could accurately predict patient arrivals. The causality test indicated internet search index as a strong predictor of ED patient arrivals. With the internet search index, the mean absolute percentage error (MAPE) and the root mean square error (RMSE) of the linear model reduced from 5.3% to 5.0% and from 24.44 to 23.18, respectively, whereas the MAPE and RMSE of the nonlinear model decreased even more, from 3.5% to 3% and from 16.72 to 14.55, respectively. Compared with each other, the experimental results revealed that the forecasting system with extreme learning machine, as well as the internet search index, had the best performance in both forecasting accuracy and robustness analysis. Conclusions: The proposed forecasting system can make accurate, real-time prediction of ED patient arrivals. Compared with the static traditional variables, the internet search index significantly improves forecasting as a reliable predictor monitoring continuous behavior trend and sudden changes during the epidemic ( P =.002). The nonlinear model performs better than the linear counterparts by capturing the dynamic relationship between the index and patient arrivals. Thus, the system can facilitate staff planning and workflow monitoring.

The effect of visibility on forecast and inventory management performance during the COVID-19 pandemic

A Comparison of Univariate and Multivariate Forecasting Models Predicting Emergency Department Patient Arrivals during the COVID-19 Pandemic

Reconfiguring a hierarchical supply chain model under pandemic using text mining and social media analysis

A mathematical model for managing the multi-dimensional impacts of the COVID-19 pandemic in supply chain of a high-demand item

Forecasting and planning during a pandemic: COVID-19 growth rates, supply chain disruptions, and governmental decisions

Impact of COVID-19 Epidemics on Bed Requirements in a Healthcare Center Using Data-Driven Discrete-Event Simulation.

Is it an opportunity? COVID-19's effect on the green supply chains, and perceived service's quality (SERVQUAL): the moderate effect of big data analytics in the healthcare sector

Application of expected value and chance constraint on uncertain supply chain model with cost, risk and visibility for COVID-19 pandemic

Enhancing Emergency Department Management: A Data-Driven Approach to Detect and Predict Surge Persistence

Forecasting Patient Flows with Pandemic Induced Concept Drift using Explainable Machine Learning

The Effect of COVID-19 Pandemic on the Global Supply Chain Operations: A System Dynamics Approach

A causality analysis of risks to perishable product supply chain networks during the COVID-19 outbreak era: An extended DEMATEL method under Pythagorean fuzzy environment

Real-time forecasting of COVID-19-related hospital strain in France using a non-Markovian mechanistic model

Accurate Forecasting of Emergency Department Arrivals With Internet Search Index and Machine Learning Models: Model Development and Performance Evaluation

The challenges and realities of retailing in a COVID-19 world: Identifying trending and Vital During Crisis keywords during Covid-19 using Machine Learning (Austria as a case study)

Cross-sectional study to assess the impact of the COVID-19 pandemic on healthcare services and clinical admissions using statistical analysis and discovering hotspots in three regions of the Greater Toronto Area

Predicting pharmaceutical supply chain disruptions before and during the COVID‐19 pandemic

The economics of deep and machine learning-based algorithms for COVID-19 prediction, detection, and diagnosis shaping the organizational management of hospitals

Reporting delays: a widely neglected impact factor in COVID-19 forecasts

Supply Chain Management during a Public Health Emergency of International Concern: A Bibliometric and Content Analysis

Scenario-driven forecasting: modeling peaks and paths. Insights from the COVID-19 pandemic in Belgium