Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Estimation for generalized linear cointegration regression models through composite quantile regression approach

Estimation of Heteroscedasticity by Local Composite Quantile Regression and Matrix Decomposition

Weighted Composite Quantile Inference for Nearly Nonstationary Autoregressive Models

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Composite quantile regression and variable selection of the partial linear single-index models

Composite quantile regression and the oracle Model Selection Theory

Optimal subsampling for composite quantile regression in big data

Composite Quantile Factor Models

Composite quantile estimation in partial functional linear regression model with dependent errors

Quantile Regression with Censoring and Endogeneity

Robust estimation in a nonlinear cointegration model

DAmcqrnn: An approach to censored monotone composite quantile regression neural network estimation

Composite Change Point Estimation for Bent Line Quantile Regression

Homogeneity Pursuit in the Functional-Coefficient Quantile Regression Model for Panel Data with Censored Data

Nonparametric inference for quantile cointegrations with stationary covariates

Interquantile Shrinkage in Spatial Quantile Autoregressive Regression models

Composite quantile estimation in partially functional linear regression model with randomly censored responses

Composite Quantile Estimation in Partial Functional Linear Regression Model Based on Polynomial Spline

Functional-Coefficient Quantile Regression for Panel Data with Latent Group Structure

Quantile regression for static panel data models with time-invariant regressors

Quantile regression for general spatial panel data models with fixed effects