Abstract:We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.

Inference for Partially Linear Quantile Regression Models in Ultrahigh Dimension

Tests for ultrahigh-dimensional partially linear regression models

Estimation and Inference in Ultrahigh Dimensional Partially Linear Single-Index Models

Quantile Inference for Moderate Deviations from a Unit Root Model with Infinite Variance

Quantile Regression for Functional Partially Linear Model in Ultra-High Dimensions

Nonparametric screening for additive quantile regression in ultra-high dimension

Quantile Regression in Partially Linear Varying Coefficient Models

Reprint: Hypothesis testing on high dimensional quantile regression

Inference for possibly misspecified generalized linear models with nonpolynomial-dimensional nuisance parameters

Inference for High-Dimensional Censored Quantile Regression

Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

Testing linearity in partial functional linear quantile regression model based on regression rank scores

Neural Networks for Partially Linear Quantile Regression

Extreme quantile estimation for partial functional linear regression models with heavy‐tailed distributions

Linear hypothesis testing in ultra high dimensional generalized linear mixed models

Conditional Independence Specification Testing for Dependent Processes with Local Polynomial Quantile Regression

Testing generalized linear models with high-dimensional nuisance parameter.

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Nonparametric inference of quantile curves for nonstationary time series