Abstract:Real-time surveillance is a crucial element in the response to infectious disease outbreaks. However, the interpretation of incidence data is often hampered by delays occurring at various stages of data gathering and reporting. As a result, recent values are biased downward, which obscures current trends. Statistical nowcasting techniques can be employed to correct these biases, allowing for accurate characterization of recent developments and thus enhancing situational awareness. In this paper, we present a preregistered real-time assessment of eight nowcasting approaches, applied by independent research teams to German 7-day hospitalization incidences during the COVID-19 pandemic. This indicator played an important role in the management of the outbreak in Germany and was linked to levels of non-pharmaceutical interventions via certain thresholds. Due to its definition, in which hospitalization counts are aggregated by the date of case report rather than admission, German hospitalization incidences are particularly affected by delays and can take several weeks or months to fully stabilize. For this study, all methods were applied from 22 November 2021 to 29 April 2022, with probabilistic nowcasts produced each day for the current and 28 preceding days. Nowcasts at the national, state, and age-group levels were collected in the form of quantiles in a public repository and displayed in a dashboard. Moreover, a mean and a median ensemble nowcast were generated. We find that overall, the compared methods were able to remove a large part of the biases introduced by delays. Most participating teams underestimated the importance of very long delays, though, resulting in nowcasts with a slight downward bias. The accompanying prediction intervals were also too narrow for almost all methods. Averaged over all nowcast horizons, the best performance was achieved by a model using case incidences as a covariate and taking into account longer delays than the other approaches. For the most recent days, which are often considered the most relevant in practice, a mean ensemble of the submitted nowcasts performed best. We conclude by providing some lessons learned on the definition of nowcasting targets and practical challenges. Current trends in epidemiological indicators are often obscured by the fact that recent values are still incomplete. This is due to reporting delays and other types of delays. Statistical nowcasting methods can be used to account for these biases and reveal yet unobserved trends, thereby improving situational awareness and supporting public health decision-making. While numerous methods exist for this purpose, little is known about their behavior in real-time settings and their relative performance. In this paper, we compared eight different nowcasting methods in an application to COVID-19 hospitalization incidences in Germany from November 2021 to April 2022. Additionally, we combined the predictions of these methods to create so-called ensemble nowcasts. Our findings indicate that while all methods yielded practically useful results, some systematic biases in nowcasts occurred and the remaining uncertainty was generally underestimated. Combined ensemble nowcasts showed promising performance relative to individual models and thus represent a promising avenue for future research.

Quantifying the impact of hospital catchment area definitions on hospital admissions forecasts: COVID-19 in England, September 2020–April 2021

Comparative assessment of methods for short-term forecasts of COVID-19 hospital admissions in England at the local level

Understanding the leading indicators of hospital admissions from COVID-19 across successive waves in the UK

Forecasting spatial, socioeconomic and demographic variation in COVID-19 health care demand in England and Wales

The impact of testing and infection prevention and control strategies on within-hospital transmission dynamics of COVID-19 in English hospitals

Identifying real-time surveillance indicators that can be used to estimate COVID-19 hospital admissions

Collaborative nowcasting of COVID-19 hospitalization incidences in Germany

The Skellam Distribution revisited -Estimating the unobserved incoming and outgoing ICU COVID-19 patients on a regional level in Germany

Accurate Forecasting of Emergency Department Arrivals With Internet Search Index and Machine Learning Models: Model Development and Performance Evaluation

Towards reliable forecasting of healthcare capacity needs: A scoping review and evidence mapping

Impact of interventions to reduce nosocomial transmission of SARS-CoV-2 in English NHS Trusts: a computational modelling study

The impact of health inequity on spatial variation of COVID-19 transmission in England

Regional now- and forecasting for data reported with delay: Towards surveillance of COVID-19 infections

Assessing the utility of COVID-19 case reports as a leading indicator for hospitalization forecasting in the United States

EpiBeds: Data informed modelling of the COVID-19 hospital burden in England

Improved forecasts of influenza-associated hospitalization rates with Google Search Trends

Forecasting influenza hospital admissions within English sub-regions using hierarchical generalised additive models

Forecasting local surges in COVID-19 hospitalizations through adaptive decision tree classifiers

Forecasting COVID-19, Influenza and RSV hospitalisations over winter 2023/24 in England

Estimating the infection horizon of COVID-19 in eight countries with a data-driven approach

A hospital demand and capacity intervention approach for COVID-19 in the UK