Minimax designs for causal effects in temporal experiments with treatment habituation

Guillaume Basse,Yi Ding,Panos Toulis
DOI: https://doi.org/10.48550/arXiv.1908.03531
2020-06-04
Abstract:Randomized experiments are the gold standard for estimating the causal effects of an intervention. In the simplest setting, each experimental unit is randomly assigned to receive treatment or control, and then the outcomes in each treatment arm are compared. In many settings, however, randomized experiments need to be executed over several time periods such that treatment assignment happens at each time period. In such temporal experiments, it has been observed that the effects of an intervention on a given unit may be large when the unit is first exposed to it, but then it often attenuates, or even vanishes, after repeated exposures. This phenomenon is typically due to units' habituation to the intervention, or some other general form of learning, such as when users gradually start to ignore repeated mails sent by a promotional campaign. This paper proposes randomized designs for estimating causal effects in temporal experiments when habituation is present. We show that our designs are minimax optimal in a large class of practical designs. Our analysis is based on the randomization framework of causal inference, and imposes no parametric modeling assumptions on the outcomes.
Methodology,Applications
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to design the optimal randomized experiment to estimate the causal effect in time - series experiments when there is a habituation effect. Specifically, the paper focuses on the phenomenon that after multiple interventions, the effect of the intervention on the experimental units may weaken or disappear, that is, the habituation effect. This phenomenon has been observed in many scenarios, such as users gradually ignoring repeated promotional emails. Therefore, the paper proposes a randomized design method for estimating the causal effect in time - series experiments in the presence of the habituation effect and proves that these designs are minimax optimal among a large class of practical designs. The research conducts causal inference based on the randomization framework and does not rely on specific parametric model assumptions of the outcome.