Abstract:Selection of covariates is crucial in the estimation of average treatment effects given observational data with high or even ultra-high dimensional pretreatment variables. Existing methods for this problem typically assume sparse linear models for both outcome and univariate treatment, and cannot handle situations with ultra-high dimensional covariates. In this paper, we propose a new covariate selection strategy called double screening prior adaptive lasso (DSPAL) to select confounders and predictors of the outcome for multivariate treatments, which combines the adaptive lasso method with the marginal conditional (in)dependence prior information to select target covariates, in order to eliminate confounding bias and improve statistical efficiency. The distinctive features of our proposal are that it can be applied to high-dimensional or even ultra-high dimensional covariates for multivariate treatments, and can deal with the cases of both parametric and nonparametric outcome models, which makes it more robust compared to other methods. Our theoretical analyses show that the proposed procedure enjoys the sure screening property, the ranking consistency property and the variable selection consistency. Through a simulation study, we demonstrate that the proposed approach selects all confounders and predictors consistently and estimates the multivariate treatment effects with smaller bias and mean squared error compared to several alternatives under various scenarios. In real data analysis, the method is applied to estimate the causal effect of a three-dimensional continuous environmental treatment on cholesterol level and enlightening results are obtained.

Stepwise Choice of Covariates in High Dimensional Regression

Clustering and Prediction with Variable Dimension Covariates

Testing covariates in high-dimensional regression

Covariance Regression with High-Dimensional Predictors

Causal Inference with High-dimensional Discrete Covariates

Regressing Longitudinal Response Trajectories On A Covariate

Robust Approach for Variable Selection with High Dimensional Longitudinal Data Analysis

Testing a Single Regression Coefficient in High Dimensional Regression Model

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Variable Selection in High-Dimensional Sparse Multiresponse Linear Regression Models

Testing a Single Regression Coefficient in High Dimensional Linear Models

A New Covariate Selection Strategy for High Dimensional Data in Causal Effect Estimation with Multivariate Treatments

Principal regression for high dimensional covariance matrices

Ultra high-dimensional semiparametric longitudinal data analysis

Fast stepwise regression based on multidimensional indexes

Partially Functional Linear Regression in High Dimensions

Asymptotics of Linear Regression with Linearly Dependent Data

A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

Linear Model Selection when Covariates Contain Errors