Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Penalized Weighted Composite Quantile Regression in the Linear Regression Model with Heavy-Tailed Autocorrelated Errors

Semiparametric Expectile Regression for High-dimensional Heavy-tailed and Heterogeneous Data

Weighted Composite Quantile Inference for Nearly Nonstationary Autoregressive Models

Quantile Regression Based on the Weighted Approach with Dependent Truncated Data

A Note on Self-Weighted Quantile Estimation for Infinite Variance Quantile Autoregression Models

Penalized weighted smoothed quantile regression for high‐dimensional longitudinal data

Wild bootstrap inference for penalized quantile regression for longitudinal data

Composite quantile estimation in partial functional linear regression model with dependent errors

Weighted Quantile Regression for AR Model with Infinite Variance Errors

Interquantile Shrinkage in Spatial Quantile Autoregressive Regression models

Composite Quantile Estimation in Partial Functional Linear Regression Model Based on Polynomial Spline

Semiparametric model averaging for high dimensional conditional quantile prediction

Penalized Time-Varying Model Averaging

Quantile regression for static panel data models with time-invariant regressors

Truncated composite quantile regression with covariates measurement errors

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Nearly Semiparametric Efficient Estimation of Quantile Regression

Multiple-output composite quantile regression through an optimal transport lens

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Composite Quantile Regression For Varying Coefficient Models With Response Data Missing At Random

Quantile regression for compositional covariates