Abstract:A new estimation procedure based on the composite quantile regression is proposed for the semiparametric additive partial linear models, of which the nonparametric components are approximated by polynomial splines. The proposed estimation method can simultaneously estimate both the parametric regression coefficients and nonparametric components without any specification of the error distributions. The proposed estimation method is empirically shown to be much more efficient than the popular least-squares-based estimation method for non-normal random errors, especially for Cauchy error, and almost as efficient for normal random errors. To achieve sparsity in high-dimensional and sparse additive partial linear models, of which the number of linear covariates is much larger than the sample size but that of significant covariates is small relative to the sample size, a variable selection procedure based on adaptive Lasso is proposed to conduct estimation and variable selection simultaneously. The procedure is shown to possess the oracle property, and is much superior to the adaptive Lasso penalized least-squares-based method regardless of the random error distributions. In particular, two kinds of weights in the penalty are considered, namely the composite quantile regression estimates and Lasso penalized composite quantile regression estimates. Both types of weights perform very well with the latter performing especially well in terms of precisely selecting significant variables. The simulation results are consistent with the theoretical properties. A real data example is used to illustrate the application of the proposed methods.

Gradient-induced Model-free Variable Selection Based on Composite Quantile Regression in Reproducing Kernel Hilbert Space

GRADIENT-INDUCED MODEL-FREE VARIABLE SELECTION WITH COMPOSITE QUANTILE REGRESSION

Gradient-induced variable selection in reproducing kernel Hilbert space for survival analysis

Faithful Variable Screening for High-Dimensional Convex Regression

Variable selection via composite quantile regression with dependent errors

EFFICIENT KERNEL-BASED VARIABLE SELECTION WITH SPARSISTENCY

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable Selection in High-Dimensional Partially Linear Additive Models for Composite Quantile Regression

Robust Variable Selection and Estimation Based on Kernel Modal Regression

Variable selection for classification with derivative-induced regularization

Robust Variable Selection Based on Penalized Composite Quantile Regression for High-Dimensional Single-Index Models

Quantile Correlation-based Variable Selection

An RKHS model for variable selection in functional regression

Variable Selection in Credit Risk Models for Chinese Listed Companies

Variable selection in censored quantile regression with high dimensional data

Gradient Learning Approach For Variable Selection In Credit Scoring

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

A Transparent and Nonlinear Method for Variable Selection

Variable Selection Via Quantile Regression with the Process of Ornstein-Uhlenbeck Type

A Unified Variable Selection Approach for Varying Coefficient Models

Simultaneous Variable Selection and Parametric Estimation for Quantile Regression