Abstract:Abstract Epidemic models are being used by governments to inform public health strategies to reduce the spread of SARS-CoV-2. They simulate potential scenarios by manipulating model parameters that control processes of disease transmission and recovery. However, the validity of these parameters is challenged by the uncertainty of the impact of public health interventions on disease transmission, and the forecasting accuracy of these models is rarely investigated during an outbreak. We fitted a stochastic transmission model on reported cases, recoveries and deaths associated with SARS-CoV-2 infection across 101 countries. The dynamics of disease transmission was represented in terms of the daily effective reproduction number ( $$R_t$$ R t ). The relationship between public health interventions and $$R_t$$ R t was explored, firstly using a hierarchical clustering algorithm on initial $$R_t$$ R t patterns, and secondly computing the time-lagged cross correlation among the daily number of policies implemented, $$R_t$$ R t , and daily incidence counts in subsequent months. The impact of updating $$R_t$$ R t every time a prediction is made on the forecasting accuracy of the model was investigated. We identified 5 groups of countries with distinct transmission patterns during the first 6 months of the pandemic. Early adoption of social distancing measures and a shorter gap between interventions were associated with a reduction on the duration of outbreaks. The lagged correlation analysis revealed that increased policy volume was associated with lower future $$R_t$$ R t (75 days lag), while a lower $$R_t$$ R t was associated with lower future policy volume (102 days lag). Lastly, the outbreak prediction accuracy of the model using dynamically updated $$R_t$$ R t produced an average AUROC of 0.72 (0.708, 0.723) compared to 0.56 (0.555, 0.568) when $$R_t$$ R t was kept constant. Monitoring the evolution of $$R_t$$ R t during an epidemic is an important complementary piece of information to reported daily counts, recoveries and deaths, since it provides an early signal of the efficacy of containment measures. Using updated $$R_t$$ R t values produces significantly better predictions of future outbreaks. Our results found variation in the effect of early public health interventions on the evolution of $$R_t$$ R t over time and across countries, which could not be explained solely by the timing and number of the adopted interventions.

Parallel Trends in an Unparalleled Pandemic Difference-in-differences for infectious disease policy evaluation

Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods

Identifying and estimating effects of sustained interventions under parallel trends assumptions

Understanding Difference-in-differences methods to evaluate policy effects with staggered adoption: an application to Medicaid and HIV

Model analysis and data validation of structured prevention and control interruptions of emerging infectious diseases

Real-Time Differential Epidemic Analysis and Prediction for COVID-19 Pandemic

Reverse Engineering the Reproduction Number: A Framework for Data-Driven Counterfactual Analysis, Strategy Evaluation, and Feedback Control of Epidemics

Beyond SIRD models: a novel dynamic model for epidemics, relating infected with entries to health care units and application for identification and restraining policy

A Semiparametric Instrumented Difference-in-Differences Approach to Policy Learning

Designing Difference-in-Difference Studies with Staggered Treatment Adoption: Key Concepts and Practical Guidelines

Evolution of disease transmission during the COVID-19 pandemic: patterns and determinants

Temporal and probabilistic comparisons of epidemic interventions

Modeling time evolving COVID-19 uncertainties with density dependent asymptomatic infections and social reinforcement

Overcoming bias in estimating epidemiological parameters with realistic history-dependent disease spread dynamics

A data-driven semi-parametric model of SARS-CoV-2 transmission in the United States

An Information-Theoretic Method for Identifying Effective Treatments and Policies at the Beginning of a Pandemic

Comparative evaluation of methodologies for estimating the effectiveness of non-pharmaceutical interventions in the context of COVID-19: a simulation study

Evaluating the effectiveness of public policies on COVID-19 containment: A PSM-DID approach

What's Trending in Difference-in-Differences? A Synthesis of the Recent Econometrics Literature

Spatio-temporal models of infectious disease with high rates of asymptomatic transmission

Transmission dynamics of the COVID‐19 outbreak and effectiveness of government interventions: A data‐driven analysis