Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Communication-efficient Sparse Composite Quantile Regression for Distributed Data

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Multi-round Smoothed Composite Quantile Regression for Distributed Data

Sparse and Debiased Lasso Estimation and Inference for High-Dimensional Composite Quantile Regression with Distributed Data

Estimation of Heteroscedasticity by Local Composite Quantile Regression and Matrix Decomposition

Distributed Online Quantile Regression over Networks with Quantized Communication.

Communication-Efficient Modeling with Penalized Quantile Regression for Distributed Data

Communication-efficient Estimation of High-Dimensional Quantile Regression

Communication-efficient Estimation of Quantile Matrix Regression for Massive Datasets

Distributed Quantile Regression over Sensor Networks

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Communication-Efficient Nonparametric Quantile Regression via Random Features

Optimal Subsampling for Composite Quantile Regression Model in Massive Data

Distributed quantile regression for massive heterogeneous data

Optimal subsampling for composite quantile regression in big data

General composite quantile regression: Theory and methods

Adaptive Composite Quantile Regressions and Their Asymptotic Relative Efficiency

Distributed High-Dimensional Quantile Regression: Estimation Efficiency and Support Recovery

Optimal subsampling algorithm for composite quantile regression with distributed data

Renewable Composite Quantile Method and Algorithm for Nonparametric Models with Streaming Data

Quantized Distributed Estimation with Adaptive Combiner