Abstract:When estimating causal effects from observational studies, researchers often need to adjust for many covariates to deconfound the non-causal relationship between exposure and outcome, among which many covariates are discrete. The behavior of commonly used estimators in the presence of many discrete covariates is not well understood since their properties are often analyzed under structural assumptions including sparsity and smoothness, which do not apply in discrete settings. In this work, we study the estimation of causal effects in a model where the covariates required for confounding adjustment are discrete but high-dimensional, meaning the number of categories $d$ is comparable with or even larger than sample size $n$. Specifically, we show the mean squared error of commonly used regression, weighting and doubly robust estimators is bounded by $\frac{d^2}{n^2}+\frac{1}{n}$. We then prove the minimax lower bound for the average treatment effect is of order $\frac{d^2}{n^2 \log^2 n}+\frac{1}{n}$, which characterizes the fundamental difficulty of causal effect estimation in the high-dimensional discrete setting, and shows the estimators mentioned above are rate-optimal up to log-factors. We further consider additional structures that can be exploited, namely effect homogeneity and prior knowledge of the covariate distribution, and propose new estimators that enjoy faster convergence rates of order $\frac{d}{n^2} + \frac{1}{n}$, which achieve consistency in a broader regime. The results are illustrated empirically via simulation studies.

Estimation of Limited Dependent Variable Models With Dummy Endogenous Regressors

Estimation in a generalization of bivariate probit models with dummy endogenous regressors

Bayesian variable selection in linear regression models with instrumental variables

Semiparametric least squares estimation of binary choice panel data models with endogeneity

Economic Motivations for Limited Dependent and Qualitative Variable Models*

Additive Nonparametric Regression in the Presence of Endogenous Regressors

Estimating dynamic spatial panel data models with endogenous regressors using synthetic instruments

Estimation of treatment effects under endogeneous heteroskedasticity

Robust Estimation of Causal Effects of Binary Treatments in Unconfounded Studies with Dichotomous Outcomes

Linear Regression for Dependently Censored Panel Duration Models with Nonadditive Fixed E ff ects

High Dimensional Binary Choice Model with Unknown Heteroskedasticity or Instrumental Variables

Difference in Differences and Ratio in Ratios for Limited Dependent Variables

A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment

Semiparametric Estimation Of Dynamic Binary Choice Panel Data Models

Bayesian variable selection in hierarchical difference-in-differences models

Inference In Partially Identified Panel Data Models With Interactive Fixed Effects

Predictive modeling for limited distributed targets

Causal Inference with High-dimensional Discrete Covariates

Revisiting Panel Data Discrete Choice Models with Lagged Dependent Variables

Testing the binomial fixed effects logit model, with an application to female labour supply

The causal interpretation of estimated associations in regression models