A Nonparametric Test of Heterogeneous Treatment Effects under Interference

Julius Owusu
DOI: https://doi.org/10.48550/arXiv.2410.00733
2024-10-01
Abstract:Statistical inference of heterogeneous treatment effects (HTEs) across predefined subgroups is challenging when units interact because treatment effects may vary by pre-treatment variables, post-treatment exposure variables (that measure the exposure to other units' treatment statuses), or both. Thus, the conventional HTEs testing procedures may be invalid under interference. In this paper, I develop statistical methods to infer HTEs and disentangle the drivers of treatment effects heterogeneity in populations where units interact. Specifically, I incorporate clustered interference into the potential outcomes model and propose kernel-based test statistics for the null hypotheses of (i) no HTEs by treatment assignment (or post-treatment exposure variables) for all pre-treatment variables values and (ii) no HTEs by pre-treatment variables for all treatment assignment vectors. I recommend a multiple-testing algorithm to disentangle the source of heterogeneity in treatment effects. I prove the asymptotic properties of the proposed test statistics. Finally, I illustrate the application of the test procedures in an empirical setting using an experimental data set from a Chinese weather insurance program.
Econometrics
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of how to make statistical inferences on Heterogeneous Treatment Effects (HTEs) in the presence of interference. Specifically: 1. **Background problems**: - In causal inference, the focus is usually on identifying and estimating the Average Treatment Effect (ATE) of the population. However, although these overall effect indicators are helpful for measuring social welfare, they often overlook the differences in treatment effects among individuals. - These differences are crucial for designing treatment assignment rules that maximize welfare. For example, an employment assistance program may have a positive impact on overall income and welfare, but it can also lead to significant inequalities in income and welfare in society because the effectiveness of the program varies from person to person. 2. **Existence of interference**: - Interference means that the treatment response of a unit depends not only on its own treatment state but also on the treatment states of other units. For example, the vaccination rates between cities can affect the effectiveness of an individual's vaccine. - When interference exists, traditional HTE testing methods (which assume no interference between units) may produce inaccurate results. 3. **Research objectives**: - The author proposes two non - parametric testing methods for inferring HTEs between different sub - groups in the presence of interference. - Specifically, the author introduces kernel - based test statistics to test the following two null hypotheses: - (i) Constant Treatment Effects (CTEs) of treatment assignment (or post - treatment exposure variables) under all pre - treatment variable values; - (ii) CTEs of pre - treatment variables under all treatment assignment vectors. - The author recommends using Holm (1979)'s multiple testing procedure to jointly test these two null hypotheses and distinguish the sources of treatment effect heterogeneity. 4. **Theoretical contributions**: - The author proves that the proposed test statistics have the property of asymptotically standard normal distribution, which is achieved through the Poissonization techniques proposed by Rosenblatt (1975) and Giné et al. (2003). - The author also shows the asymptotic validity and power of these test statistics under fixed alternative hypotheses and sequences of local alternative hypotheses. 5. **Practical applications**: - The author conducts an empirical analysis using a Chinese weather insurance policy data set to illustrate the application of the proposed method. In summary, the main contribution of this paper is to provide a new statistical method that can effectively infer HTEs in the presence of interference and help policy - makers better understand the sources of treatment effect heterogeneity.