Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

ELASTIC-NET REGULARIZED HIGH-DIMENSIONAL NEGATIVE BINOMIAL REGRESSION: CONSISTENCY AND WEAK SIGNAL DETECTION

Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signals Detection

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Nonnegative Estimation and Variable Selection Via Adaptive Elastic-Net for High-Dimensional Data

Consistency of $\ell _{1}$ Penalized Negative Binomial Regressions

Reweighted Nonnegative Least-Mean-Square Algorithm

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Complete Consistency for the Estimator of Nonparametric Regression Models Based on Extended Negatively Dependent Errors

A Naïve Bayes Regularized Logistic Regression Estimator for Low-dimensional Classification

Stability of the Elastic Net Estimator

Nonnegative Elastic Net and application in index tracking

Efficient Tuning-Free $\ell_1$-Regression of Nonnegative Compressible Signals

A Group Adaptive Elastic-Net Approach for Variable Selection in High-Dimensional Linear Regression

On Estimation Error Bounds of the Elastic Net when P ≫ N

Rates of Convergence of the Adaptive Elastic Net and the Post-Selection Procedure in Ultra-High Dimensional Sparse Models

HIGH-DIMENSIONAL LEAST SQUARE MATRIX REGRESSION VIA ELASTIC NET PENALTY

Robust Nonnegative Mixed-Norm Algorithm with Weighted $L_{1}$-Norm Regularization

Accurate inference in negative binomial regression

Discriminative elastic-net regularized linear regression

NONCONCAVE PENALIZED M-ESTIMATION WITH A DIVERGING NUMBER OF PARAMETERS

Variance Estimation in High-Dimensional Linear Regression Via Adaptive Elastic-Net