Abstract:Seasonal influenza results in substantial annual morbidity and mortality in the United States and worldwide. Accurate forecasts of key features of influenza epidemics, such as the timing and severity of the peak incidence in a given season, can inform public health response to outbreaks. As part of ongoing efforts to incorporate data and advanced analytical methods into public health decision-making, the United States Centers for Disease Control and Prevention (CDC) has organized seasonal influenza forecasting challenges since the 2013/2014 season. In the 2017/2018 season, 22 teams participated. A subset of four teams created a research consortium called the FluSight Network in early 2017. During the 2017/2018 season they worked together to produce a collaborative multi-model ensemble that combined 21 separate component models into a single model using a machine learning technique called stacking. This approach creates a weighted average of predictive densities where the weight for each component is determined by maximizing overall ensemble accuracy over past seasons. In the 2017/2018 influenza season, one of the largest seasonal outbreaks in the last 15 years, this multi-model ensemble performed better on average than all individual component models and placed second overall in the CDC challenge. It also outperformed the baseline multi-model ensemble created by the CDC that took a simple average of all models submitted to the forecasting challenge. This project shows that collaborative efforts between research teams to develop ensemble forecasting approaches can bring measurable improvements in forecast accuracy and important reductions in the variability of performance from year to year. Efforts such as this, that emphasize real-time testing and evaluation of forecasting models and facilitate the close collaboration between public health officials and modeling researchers, are essential to improving our understanding of how best to use forecasts to improve public health response to seasonal and emerging epidemic threats.Seasonal influenza outbreaks cause millions of infections and tens of thousands of deaths in the United States each year. Forecasting the track of an influenza season can help public health officials, business leaders, and the general public decide how to respond to an ongoing or emerging outbreak. Our team assembled over 20 unique forecasting models for seasonal influenza and combined them together into a single "ensemble" model. We made predictions of the 2017/2018 influenza season, each week sending real-time forecasts to the US Centers for Disease Control and Prevention (CDC). In the 2017/2018 influenza season, one of the largest seasonal outbreaks in the last 15 years, our ensemble model performed better on average than all individual forecast models in the ensemble. Based on results from this study, the CDC used forecasts from our ensemble model in public communication and internal reports in the subsequent 2018/2019 influenza season.

A prospective real-time transfer learning approach to estimate Influenza hospitalizations with limited data.

Flusion: Integrating multiple data sources for accurate influenza predictions

Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance

Forecasting new diseases in low-data settings using transfer learning

Random Forest of Epidemiological Models for Influenza Forecasting

An adaptive weight ensemble approach to forecast influenza activity in an irregular seasonality context

An Imputation-Based Approach for Augmenting Sparse Epidemiological Signals

Improved forecasts of influenza-associated hospitalization rates with Google Search Trends

Adaptively stacking ensembles for influenza forecasting with incomplete data

Evaluation of FluSight influenza forecasting in the 2021-22 and 2022-23 seasons with a new target laboratory-confirmed influenza hospitalizations

Influenza Forecasting with Google Flu Trends

Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the U.S.

LSTM-based recurrent neural network provides effective short term flu forecasting

Chimeric Forecasting: Blending Human Judgment and Computational Methods for Improved, Real-time Forecasts of Influenza Hospitalizations

Real-time predictive seasonal influenza model in Catalonia, Spain

Improved Real-Time Influenza Surveillance: Using Internet Search Data in Eight Latin American Countries

Prediction of hospital-acquired influenza using machine learning algorithms: a comparative study

Long-term Regional Influenza-like-illness Forecasting Using Exogenous Data

Applying infectious disease forecasting to public health: a path forward using influenza forecasting examples

Cloud-based Electronic Health Records for Real-time, Region-specific Influenza Surveillance

Predicting outcomes in older ED patients with influenza in real time using a big data-driven and machine learning approach to the hospital information system