Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Asymptotic Normality for a Local Composite Quantile Regression Estimator of Regression Function with Truncated Data

Estimation of Heteroscedasticity by Local Composite Quantile Regression and Matrix Decomposition

Composite Quantile Regression Estimation for Left Censored Response Longitudinal Data

Truncated composite quantile regression with covariates measurement errors

Optimal subsampling for composite quantile regression in big data

Quantile Regression Based on the Weighted Approach with Dependent Truncated Data

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Composite Quantile Regression For Varying Coefficient Models With Response Data Missing At Random

Density-Calibrated Conformal Quantile Regression

Weighted Composite Quantile Inference for Nearly Nonstationary Autoregressive Models

DAmcqrnn: An approach to censored monotone composite quantile regression neural network estimation

Composite quantile regression and variable selection of the partial linear single-index models

Parametric modeling of quantile regression coefficient functions with censored and truncated data

ASYMPTOTICALLY EFFICIENT ESTIMATION IN CENSORED AND TRUNCATED REGRESSION-MODELS

Composite quantile estimation in partially functional linear regression model with randomly censored responses

Asymptotic Normality of an M-estimator of regression function for truncated-censored data under alpha-mixing condition

Prediction Accuracy Measures for Time-to-event Models with Left-Truncated and Right-Censored Data

Asymptotic normality of locally modelled regression estimator for functional data

Estimation for generalized linear cointegration regression models through composite quantile regression approach

Rank Regression Methods for Left-Truncated and Right-Censored Data

Quantile difference estimation with censoring indicators missing at random