Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Random Weighting Method for M-test in Linear Model with Dependent Errors

Approximation by Random Weighting Method for M-test in Linear Models

Approximating Null Distribution of the M-Test Statistics in Linear Models

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

A Randomly Weighting Approximation Approach for Two-Tailed Censored Regression Model

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

APPROXIMATING THE DISTRIBUTION OF M-ESTIMATORS IN LINEAR MODELS BY RANDOMLY WEIGHTED BOOTSTRAP

Approximation by Randomly Weighting Method in Censored Regression Model

Checking for Normality in Linear Mixed Models

Randomly weighted method in parameter estimation of generalized linear model

Asymptotic Efficiency of Randomly Weighted Bootstrap for Linear Models

M-Testing Using Finite and Infinite Dimensional Parameter Estimators

A Large Sample Study of Randomly Weighted Bootstrap in Linear Models

The Testing of Random Effect in Mixed Generalized Single Index Models

A Shrinkage Method for Testing the Hardy–Weinberg Equilibrium in Case‐Control Studies

Weighted Estimator for the Linear Transformation Models with Multivariate Failure Time Data

Weighted residual empirical processes, martingale transformations and model checking for regressions

Testing for Random Effects in Linear Mixed Models for Longitudinal Data under Moment Conditions

Weighted Stochastic Restricted Estimation in Linear Measurement Error Models

Test for high-dimensional linear hypothesis of mean vectors via random integration

Random Weighting Estimation of Poisson Distributions