Abstract:The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart for high-dimensional sparse models was recently studied in Gu and Zou [IEEE Trans. Inf. Theory 66 (2020) 7132--7154], along with a specialized optimization algorithm based on the alternating direct method of multipliers (ADMM). Compared to the various first-order algorithms for penalized least squares, ADMM-based algorithms are not well-adapted to large-scale problems. To overcome this computational hardness, in this paper we employ a convolution-smoothed technique to CQR, complemented with iteratively reweighted $\ell_1$-regularization. The smoothed composite loss function is convex, twice continuously differentiable, and locally strong convex with high probability. We propose a gradient-based algorithm for penalized smoothed CQR via a variant of the majorize-minimization principal, which gains substantial computational efficiency over ADMM. Theoretically, we show that the iteratively reweighted $\ell_1$-penalized smoothed CQR estimator achieves near-minimax optimal convergence rate under heavy-tailed errors without any moment constraint, and further achieves near-oracle convergence rate under a weaker minimum signal strength condition than needed in Gu and Zou (2020). Numerical studies demonstrate that the proposed method exhibits significant computational advantages without compromising statistical performance compared to two state-of-the-art methods that achieve robustness and high efficiency simultaneously.

Truncated composite quantile regression with covariates measurement errors

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Quantile Regression Based on the Weighted Approach with Dependent Truncated Data

Corrected-loss estimation for quantile regression with covariate measurement errors

Variable selection via composite quantile regression with dependent errors

Composite quantile estimation in partially functional linear regression model with randomly censored responses

Composite quantile estimation in partial functional linear regression model with dependent errors

Statistical inference for linear quantile regression with measurement error in covariates and nonignorable missing responses

QUANTILE REGRESSION WITH COVARIATES MISSING AT RANDOM

Weighted Composite Quantile Inference for Nearly Nonstationary Autoregressive Models

Quantile Regression in Longitudinal Studies with Dropouts and Measurement Errors

Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data

High-Dimensional Composite Quantile Regression: Optimal Statistical Guarantees and Fast Algorithms

Optimal subsampling for composite quantile regression in big data

Quantile regression and empirical likelihood for the analysis of longitudinal data with monotone missing responses due to dropout, with applications to quality of life measurements from clinical trials.

Weighted Quantile Regression in Varying-Coefficient Model with Longitudinal Data

Composite quantile regression and variable selection of the partial linear single-index models

Composite Quantile Estimation in Partial Functional Linear Regression Model Based on Polynomial Spline

Multiple-output composite quantile regression through an optimal transport lens

Analysis of Longitudinal Data with Covariate Measurement Error and Missing Responses: an Improved Unbiased Estimating Equation.

Multiply Robust Estimation of Quantile Treatment Effects with Missing Responses