Inferring causal impact using Bayesian structural time-series models

Kay H. Brodersen,Fabian Gallusser,Jim Koehler,Nicolas Remy,Steven L. Scott
DOI: https://doi.org/10.1214/14-AOAS788
2015-06-01
Abstract:An important problem in econometrics and marketing is to infer the causal impact that a designed market intervention has exerted on an outcome metric over time. This paper proposes to infer causal impact on the basis of a diffusion-regression state-space model that predicts the counterfactual market response in a synthetic control that would have occurred had no intervention taken place. In contrast to classical difference-in-differences schemes, state-space models make it possible to (i) infer the temporal evolution of attributable impact, (ii) incorporate empirical priors on the parameters in a fully Bayesian treatment, and (iii) flexibly accommodate multiple sources of variation, including local trends, seasonality and the time-varying influence of contemporaneous covariates. Using a Markov chain Monte Carlo algorithm for posterior inference, we illustrate the statistical properties of our approach on simulated data. We then demonstrate its practical utility by estimating the causal effect of an online advertising campaign on search-related site visits. We discuss the strengths and limitations of state-space models in enabling causal attribution in those settings where a randomised experiment is unavailable. The CausalImpact R package provides an implementation of our approach.
Applications
What problem does this paper attempt to address?
This paper aims to solve the problem of how to infer the causal impact of market interventions on an outcome indicator over time. Specifically, the author proposes a method based on the Diffusion Regression State - Space Model to predict the counterfactual situation of market responses if no intervention had been carried out. Compared with the traditional Difference - in - Differences method, this method has the following advantages: 1. **Infer the Temporal Evolution of Causal Impact**: It can infer how the causal impact changes over time. 2. **Full Bayesian Treatment**: It can combine prior knowledge and perform a full Bayesian treatment on model parameters. 3. **Flexibly Adapt to Multiple Sources of Variation**: It can flexibly handle multiple sources of variation, including local trends, seasonality, and the time - varying effects of contemporaneous covariates. By using the Markov Chain Monte Carlo algorithm for posterior inference, the author demonstrates the statistical properties of this method on simulated data and shows its practical application value by estimating the causal effect of online advertising campaigns on the number of visits to search - related websites. In addition, the author discusses the advantages and limitations of state - space models in causal attribution when randomized experiments are not possible and provides the CausalImpact R package for implementing this method.