Abstract:Detail is a double edged sword in epidemiological modelling. The inclusion of mechanistic detail in models of highly complex systems has the potential to increase realism, but it also increases the number of modelling assumptions, which become harder to check as their possible interactions multiply. In a major study of the Covid-19 epidemic in England, Knock et al. (2020) fit an age structured SEIR model with added health service compartments to data on deaths, hospitalization and test results from Covid-19 in seven English regions for the period March to December 2020. The simplest version of the model has 684 states per region. One main conclusion is that only full lockdowns brought the pathogen reproduction number, R, below one, with R ≫ 1 in all regions on the eve of March 2020 lockdown. We critically evaluate the Knock et al. epidemiological model, and the semi-causal conclusions made using it, based on an independent reimplementation of the model designed to allow relaxation of some of its strong assumptions. In particular, Knock et al. model the effect on transmission of both non-pharmaceutical interventions and other effects, such as weather, using a piecewise linear function, b(t), with 12 breakpoints at selected government announcement or intervention dates. We replace this representation by a smoothing spline with time varying smoothness, thereby allowing the form of b(t) to be substantially more data driven, and we check that the corresponding smoothness assumption is not driving our results. We also reset the mean incubation time and time from first symptoms to hospitalisation, used in the model, to values implied by the papers cited by Knock et al. as the source of these quantities. We conclude that there is no sound basis for using the Knock et al. model and their analysis to make counterfactual statements about the number of deaths that would have occurred with different lockdown timings. However, if fits of this epidemiological model structure are viewed as a reasonable basis for inference about the time course of incidence and R, then without very strong modelling assumptions, the pathogen reproduction number was probably below one, and incidence in substantial decline, some days before either of the first two English national lockdowns. This result coincides with that obtained by more direct attempts to reconstruct incidence. Of course it does not imply that lockdowns had no effect, but it does suggest that other non-pharmaceutical interventions (NPIs) may have been much more effective than Knock et al. imply, and that full lockdowns were probably not the cause of R dropping below one.

Don't Jump to Faulty Conclusions: Using the Synthetic Control Method to Evaluate the Effect of a Counterfactual Lockdown in Sweden

Short, stringent lockdowns halted SARS-CoV-2 transmissions in Danish municipalities

Leveraging epidemiological principles to evaluate Sweden's COVID-19 response

An empirical application of herding behavior and compliance in the COVID‐19 crisis

Impact of national lockdown on COVID-19 deaths in select European countries and the US using a Changes-in-Changes model

A counterfactual analysis quantifying the COVID-19 vaccination impact in Sweden

Breaking Down the Lockdown: The Causal Effects of Stay-At-Home Mandates on Uncertainty and Sentiments During the COVID-19 Pandemic

Media coverage and pandemic behavior: Evidence from Sweden

Comparison of Predictive Models and Impact Assessment of Lockdown for COVID-19 over the United States

Analyzing the Effectiveness of COVID-19 Lockdown Policies Using the Time-Dependent Reproduction Number and the Regression Discontinuity Framework: Comparison Between Countries

Was R < 1 before the English lockdowns? On modelling mechanistic detail, causality and inference about Covid-19

Did the Indian lockdown avert deaths?

A Study on The Effectiveness of Lock-down Measures to Control The Spread of COVID-19

Inferring UK COVID-19 fatal infection trajectories from daily mortality data: were infections already in decline before the UK lockdowns?

A Lockdown a Day Keeps the Doctor Away: The Global Effectiveness of Non-Pharmaceutical Interventions in Mitigating the Covid-19 Pandemic

Impact of adherence and stringency on the effectiveness of lockdown measures: a modelling study

COVID-19 epidemic control using short-term lockdowns for collective gain

Lockdown Strategies, Mobility Patterns and COVID-19

Modeling the Influence of Lockdown on Epidemic Progression and Economy

Covid-19 Lockdown Cost/Benefits: A Critical Assessment of the Literature

Optimal Lockdown Strategy in a Pandemic: An Exploratory Analysis for Covid-19