Abstract:We propose both a penalized quantile regression and an independence screening procedure to identify important covariates and to exclude unimportant ones for a general class of ultrahigh dimensional single-index models, in which the conditional distribution of the response depends on the covariates via a single-index structure. We observe that the linear quantile regression yields a consistent estimator of the direction of the index parameter in the single-index model. Such an observation dramatically reduces computational complexity in selecting important covariates in the single-index model. We establish an oracle property for the penalized quantile regression estimator when the covariate dimension increases at an exponential rate of the sample size. From a practical perspective, however, when the covariate dimension is extremely large, the penalized quantile regression may suffer from at least two drawbacks: computational expediency and algorithmic stability. To address these issues, we propose an independence screening procedure which is robust to model misspecification, and has reliable performance when the distribution of the response variable is heavily tailed or response realizations contain extreme values. The new independence screening procedure offers a useful complement to the penalized quantile regression since it helps to reduce the covariate dimension from ultrahigh dimensionality to a moderate scale. Based on the reduced model, the penalized linear quantile regression further refines selection of important covariates at different quantile levels. We examine the finite sample performance of the newly proposed procedure by Monte Carlo simulations and demonstrate the proposed methodology by an empirical analysis of a real data set.

Robust Variable Selection Based on Penalized Composite Quantile Regression for High-Dimensional Single-Index Models

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Estimation and Variable Selection in Single-Index Composite Quantile Regression

Robust Variable Selection in Partially Varying Coefficient Single-Index Model

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable Selection in High-Dimensional Partially Linear Additive Models for Composite Quantile Regression

Quantile Regression and Variable Selection for Single-Index Varying-Coefficient Models

A new variable selection and estimation algorithm for the high-dimensional quantile single-index model

SCAD‐penalized Quantile Regression for High‐dimensional Data Analysis and Variable Selection

A Lasso-Type Approach for Estimation and Variable Selection in Single Index Models

Variable selection for partially linear single-index varying-coefficient model

Robust Variable Selection for Single-Index Varying-Coefficient Model with Missing Data in Covariates

Variable Selection for the Partial Linear Single-Index Model

Regularized Quantile Regression and Robust Feature Screening for Single Index Models

Simultaneous Variable Selection and Parametric Estimation for Quantile Regression

Non-convex Penalized Estimation in High-Dimensional Models with Single-Index Structure

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

A robust and efficient estimation and variable selection method for partially linear single-index models.

Robust Estimation and Variable Selection for Varying-Coefficient Single-Index Models Based on Modal Regression

Robust Check Loss-Based Variable Selection of High-Dimensional Single-Index Varying-Coefficient Model.

Variable selection and estimation for semi-parametric multiple-index models