Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Non-crossing convex quantile regression

Nonparametric Quantile Regression: Non-Crossing Constraints and Conformal Prediction

No-Crossing Single-Index Quantile Regression Curve Estimation

Penalized regression across multiple quantiles under random censoring

Interquantile Shrinkage in Spatial Quantile Autoregressive Regression models

Quantile and Probability Curves Without Crossing

A Smoothing Iterative Method for Quantile Regression with Nonconvex \begin{document}$ \ell_p $\end{document} Penalty

General composite quantile regression: Theory and methods

Non-crossing weighted kernel quantile regression with right censored data

Convergence Rate for Nonparametric Quantile Regression with a Total Variation Penalty

An Effective Method to Reduce the Computational Complexity of Composite Quantile Regression

Partial frontiers are not quantiles

Nonparametric quantile frontier estimation under shape restriction.

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Conformalized quantile regression

Penalized weighted smoothed quantile regression for high‐dimensional longitudinal data

An Empirical Quantile Estimation Approach for Chance-Constrained Nonlinear Optimization Problems

Sparse quantile regression

Interquantile Shrinkage in Spatial Additive Autoregressive Models

An Empirical Quantile Estimation Approach to Nonlinear Optimization Problems with Chance Constraints

Nonparametric C- and D-vine based quantile regression