Abstract:A new estimation procedure based on the composite quantile regression is proposed for the semiparametric additive partial linear models, of which the nonparametric components are approximated by polynomial splines. The proposed estimation method can simultaneously estimate both the parametric regression coefficients and nonparametric components without any specification of the error distributions. The proposed estimation method is empirically shown to be much more efficient than the popular least-squares-based estimation method for non-normal random errors, especially for Cauchy error, and almost as efficient for normal random errors. To achieve sparsity in high-dimensional and sparse additive partial linear models, of which the number of linear covariates is much larger than the sample size but that of significant covariates is small relative to the sample size, a variable selection procedure based on adaptive Lasso is proposed to conduct estimation and variable selection simultaneously. The procedure is shown to possess the oracle property, and is much superior to the adaptive Lasso penalized least-squares-based method regardless of the random error distributions. In particular, two kinds of weights in the penalty are considered, namely the composite quantile regression estimates and Lasso penalized composite quantile regression estimates. Both types of weights perform very well with the latter performing especially well in terms of precisely selecting significant variables. The simulation results are consistent with the theoretical properties. A real data example is used to illustrate the application of the proposed methods.

GRADIENT-INDUCED MODEL-FREE VARIABLE SELECTION WITH COMPOSITE QUANTILE REGRESSION

Gradient-induced Model-free Variable Selection Based on Composite Quantile Regression in Reproducing Kernel Hilbert Space

Faithful Variable Screening for High-Dimensional Convex Regression

Variable Selection in High-Dimensional Partially Linear Additive Models for Composite Quantile Regression

Simultaneous Variable Selection and Parametric Estimation for Quantile Regression

Variable selection via composite quantile regression with dependent errors

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Robust Variable Selection Based on Penalized Composite Quantile Regression for High-Dimensional Single-Index Models

Quantile Regression and Variable Selection for Single-Index Varying-Coefficient Models

A Unified Variable Selection Approach for Varying Coefficient Models

Weighted Composite Quantile Regression Estimation and Variable Selection for Varying Coefficient Models with Heteroscedasticity

Robust Variable Selection and Estimation Based on Kernel Modal Regression

Quantile regression for robust estimation and variable selection in partially linear varying-coefficient models

VARIABLE SELECTION IN SPARSE REGRESSION WITH QUADRATIC MEASUREMENTS

Gradient-induced variable selection in reproducing kernel Hilbert space for survival analysis

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

SCAD‐penalized Quantile Regression for High‐dimensional Data Analysis and Variable Selection

Gradient Learning Approach For Variable Selection In Credit Scoring

A Transparent and Nonlinear Method for Variable Selection

Variable Selection in High-Dimensional Sparse Multiresponse Linear Regression Models

Incorporating Graphical Structure of Predictors in Sparse Quantile Regression