Abstract:We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.

The Bahadur Representation for Empirical and Smooth Quantile Estimators Under Association

Bahadur Representation of Linear Kernel Quantile Estimator for Stationary Processes

Nonparametric Estimation of Quantiles for A Class of Stationary Processes

The Bahadur Representation for Sample Quantiles Under Dependent Sequence

Bahadur Representation of Nonparametric M-Estimators for Spatial Processes

Smooth estimation of conditional quantile function with mixed covariates using Bernstein polynomials

Some practical and theoretical issues related to the quantile estimators

Optimal rates in the Bahadur-Kiefer representation for GARCH sequences

Statistical properties of approximate geometric quantiles in infinite-dimensional Banach spaces

Reducing bias and variance in quantile estimates with an exponential model

Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

Bayesian Inference on Multivariate Medians and Quantiles

Berry-Esseen Theorem for Sample Quantiles with Locally Dependent Data

Bayesian Quantile Regression for Ordinal Models

Weighted quantile estimators

Statistical Barriers to Affine-equivariant Estimation

Conditional Empirical Likelihood for Quantile Regression Models

Estimation of the distribution and density functions using Bernstein polynomials under weak dependence

Error bounds on the non-normal approximation of Hermite power variations of fractional Brownian motion

Nonparametric inference of quantile curves for nonstationary time series

Quantile Regression Neural Networks: A Bayesian Approach