Abstract:We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.

Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond

Estimating Identifiable Causal Effects through Double Machine Learning

Robust Causal Learning for the Estimation of Average Treatment Effects

Estimating individual treatment effect: generalization bounds and algorithms

Anytime-Valid Inference for Double/Debiased Machine Learning of Causal Parameters

Program Evaluation and Causal Inference with High-Dimensional Data

Double Machine Learning meets Panel Data -- Promises, Pitfalls, and Potential Solutions

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Robust Orthogonal Machine Learning of Treatment Effects

Double/debiased machine learning for logistic partially linear model

Automatic doubly robust inference for linear functionals via calibrated debiased machine learning

Estimating Distributional Treatment Effects in Randomized Experiments: Machine Learning for Variance Reduction

Highly adaptive LASSO: Machine learning that provides valid nonparametric inference in realistic models

C-Learner: Constrained Learning for Causal Inference and Semiparametric Statistics

Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

Triple/Debiased Lasso for Statistical Inference of Conditional Average Treatment Effects

Improving the Finite Sample Performance of Double/Debiased Machine Learning with Propensity Score Calibration

Targeted Learning on Variable Importance Measure for Heterogeneous Treatment Effect

Machine learning in policy evaluation: new tools for causal inference

Estimating Causal Effects with Double Machine Learning -- A Method Evaluation

Double Machine Learning for Static Panel Models with Fixed Effects