Abstract:Projects such as the European Covid-19 Forecast Hub publish forecasts on the national level for new deaths, new cases, and hospital admissions, but not direct measurements of hospital strain like critical care bed occupancy at the sub-national level, which is of particular interest to health professionals for planning purposes. We present a sub-national French framework for forecasting hospital strain based on a non-Markovian compartmental model, its associated online visualisation tool and a retrospective evaluation of the real-time forecasts it provided from January to December 2021 by comparing to three baselines derived from standard statistical forecasting methods (a naive model, auto-regression, and an ensemble of exponential smoothing and ARIMA). In terms of median absolute error for forecasting critical care unit occupancy at the two-week horizon, our model only outperformed the naive baseline for 4 out of 14 geographical units and underperformed compared to the ensemble baseline for 5 of them at the 90% confidence level ( n = 38). However, for the same level at the 4 week horizon, our model was never statistically outperformed for any unit despite outperforming the baselines 10 times spanning 7 out of 14 geographical units. This implies modest forecasting utility for longer horizons which may justify the application of non-Markovian compartmental models in the context of hospital-strain surveillance for future pandemics. The US and European Covid-19 Forecast Hubs focus on metrics such as deaths, new cases, and hospital admissions, but do not offer measurements of hospital strain like critical care bed occupancy, which was essential for the provisioning of healthcare resources during the COVID-19 pandemic. Furthermore, forecasting support was only guaranteed on the national level leaving many countries to look elsewhere for valuable sub-national forecasts. In France statistical modelling approaches were proposed to anticipate hospital stain at the sub-national level but these were limited by a two-week forecast horizon. We present a sub-national French modelling framework and online application for anticipating hospital strain at the four-week horizon that can account for abrupt changes in key epidemiological parameters. It was the only publicly available real-time non-Markovian mechanistic model for the French epidemic when implemented in January 2021 and, to our knowledge, it still was at the time it stopped in early 2022. Further adaptations of this surveillance system can serve as an anticipation tool for hospital strain across sub-national localities to aid in the prevention of short-noticed ward closures and patient transfers.

Retrospective analysis of Covid-19 hospitalization modelling scenarios which guided policy response in France

Estimating the population effectiveness of interventions against COVID-19 in France: a modelling study

Real-time forecasting of COVID-19-related hospital strain in France using a non-Markovian mechanistic model

Using a population-based Kalman estimator to model the COVID-19 epidemic in France: estimating associations between disease transmission and non-pharmaceutical interventions

Analysis of the tradeoff between health and economic impacts of the Covid-19 epidemic

Canada's provincial COVID-19 pandemic modelling efforts: A review of mathematical models and their impacts on the responses

COVID-19 mitigation strategies and overview on results from relevant studies in Europe

Role of modelling in COVID-19 policy development

Lessons Learned from Model-based Economic Evaluations of COVID-19 Drug Treatments Under Pandemic Circumstances: Results from a Systematic Review

Combining models to generate consensus medium-term projections of hospital admissions, occupancy and deaths relating to COVID-19 in England

Regional analysis of COVID-19 in France from fit of hospital data with different evolutionary models

Evaluating the COVID-19 responses of Belgium, Denmark, Germany, the Netherlands, Sweden and the United Kingdom, February-June 2020: A counterfactual modelling study

Analysis of SEIR-type models used at the beginning of COVID-19 pandemic reported in high-impact journals

Predicted Impacts of Booster, Immunity Decline, Vaccination Strategies, and Non-Pharmaceutical Interventions on COVID-19 Outcomes in France

On the parametrization of epidemiologic models -- lessons from modelling COVID-19 epidemic

Modelling Excess Mortality in Covid-19-like Epidemics

Validity and usefulness of COVID-19 models

Modeling the Heterogeneity in COVID-19's Reproductive Number and its Impact on Predictive Scenarios

Modeling-informed policy, policy evaluated by modeling: Evolution of mathematical epidemiology in the context of society and economy

COVID-19 Outbreak in Wuhan Demonstrates the Limitations of Publicly Available Case Numbers for Epidemiological Modeling

Multiple models for outbreak decision support in the face of uncertainty