Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Estimation of Linear Composite Quantile Regression Using Em Algorithm

Conditional Tail-Related Risk Estimation Using Composite Asymmetric Least Squares and Empirical Likelihood

Data-driven and distribution-free estimation of tailed-related risks for GARCH models using composite asymmetric least squares regression

Estimation of Heteroscedasticity by Local Composite Quantile Regression and Matrix Decomposition

Linear Quantile Regression Based on Em Algorithm

Quantile Regression via the EM Algorithm.

Weighted Composite Quantile Regression for Longitudinal Mixed Effects Models with Application to AIDS Studies

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Gibbs Sampler Algorithm of Bayesian Weighted Composite Quantile Regression

Quantile Regression for Linear Models with Autoregressive Errors Using EM Algorithm

Bayesian Composite Quantile Regression for Linear Mixed-Effects Models

Likelihood-based Quantile Mixed Effects Models for Longitudinal Data with Multiple Features Via MCEM Algorithm

Composite quantile regression and variable selection of the partial linear single-index models

Sparse and Debiased Lasso Estimation and Inference for High-Dimensional Composite Quantile Regression with Distributed Data

Communication-efficient Sparse Composite Quantile Regression for Distributed Data

Bayesian LASSO-Regularized Weighted Composite Quantile Regression with Its Application

Estimation for generalized linear cointegration regression models through composite quantile regression approach

Empirical Likelihood for Composite Quantile Regression Modeling

Estimation and Variable Selection in Single-Index Composite Quantile Regression

Composite Quantile Regression Estimation for Left Censored Response Longitudinal Data

An Effective Method to Reduce the Computational Complexity of Composite Quantile Regression