Abstract:We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.

Semisupervised inference for explained variance in high dimensional linear regression and its applications

Semi-supervised Inference for Explained Variance in High-dimensional Linear Regression and Its Applications

Nonlinear Variational Bayesian Student’s-t Mixture Regression and Inferential Sensor Application with Semisupervised Data

Semi-supervised Variational Bayesian Student’s T Mixture Regression and Robust Inferential Sensor Application

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Improved Inference for Imputation-Based Semisupervised Learning Under Misspecified Setting

Bayesian variable selection in linear regression models with instrumental variables

Efficient semi-supervised inference for logistic regression under case-control studies

Semi-supervised inference for nonparametric logistic regression

Scalable Semisupervised GMM for Big Data Quality Prediction in Multimode Processes.

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

Semi-supervised Regression Analysis with Model Misspecification and High-dimensional Data

Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

Enhancing efficiency and robustness in high-dimensional linear regression with additional unlabeled data

Semi-supervised estimation for the varying coefficient regression model

Robust Inference for High-dimensional Linear Models with Heavy-tailed Errors via Partial Gini Covariance

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Distributed Semi-Supervised Sparse Statistical Inference

Optimal and Safe Estimation for High-Dimensional Semi-Supervised Learning