Retire: Robust expectile regression in high dimensions
Rebeka Man,Kean Ming Tan,Zian Wang,Wen-Xin Zhou
DOI: https://doi.org/10.1016/j.jeconom.2023.04.004
IF: 3.363
2023-06-19
Journal of Econometrics
Abstract:High-dimensional data can often display heterogeneity due to heteroscedastic variance or inhomogeneous covariate effects. Penalized quantile and expectile regression methods offer useful tools to detect heteroscedasticity in high-dimensional data. The former is computationally challenging due to the non-smooth nature of the check loss, and the latter is sensitive to heavy-tailed error distributions. In this paper, we propose and study (penalized) r obust e xpec ti le re gression ( retire ), with a focus on iteratively reweighted l1 -penalization which reduces the estimation bias from l1 -penalization and leads to oracle properties. Theoretically, we establish the statistical properties of the retire estimator under two regimes: (i) low-dimensional regime in which d≪n ; (ii) high-dimensional regime in which s≪n≪d with s denoting the number of significant predictors. In the high-dimensional setting, we thoroughly analyze the statistical properties of the solution path of iteratively reweighted l1 -penalized retire estimation, adapted from the local linear approximation algorithm for folded-concave regularization. Under a mild minimum signal strength condition, we demonstrate that with as few as log(logd) iterations, the final iterate of our proposed approach achieves the oracle convergence rate. At each iteration, we solve the weighted l1 -penalized convex program using a semismooth Newton coordinate descent algorithm. Numerical studies demonstrate the promising performance of the proposed procedure in comparison to both non-robust and quantile regression based alternatives.
economics,social sciences, mathematical methods,mathematics, interdisciplinary applications