Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Normal approximation for nonlinear statistics using a concentration inequality approach

A Berry-Esseen theorem for incomplete U-statistics with Bernoulli sampling

Another look at Stein's method for Studentized nonlinear statistics with an application to U-statistics

On Bernstein Type Inequalities for Stochastic Integrals of Multivariate Point Processes

The Asymptotic Distribution and Berry–Esseen Bound of a New Test for Independence in High Dimension with an Application to Stochastic Optimization

Precise asymptotics in the law of the iterated logarithm for statistic

Efficient Concentration with Gaussian Approximation

Nonuniform Berry-Esseen bounds for Studentized U-statistics

Improved nonuniform Berry--Esseen-type bounds

Concentration Inequalities for Statistical Inference

The Berry-Esseen bound in de Jong's CLT

On the rate of convergence for an α-stable central limit theorem under sublinear expectation

Normal approximation in total variation for statistics in geometric probability

Central Limit Theorems for Generalizedu-Statistics with Applications in Nonparametric Specification

Berry–Esseen bound for parameter estimation in some time inhomogeneous diffusions and applications

Equivalence of concentration inequalities for linear and non-linear functions

A Note on Concentration Inequalities for U-Statistics

Normal approximation for statistics of randomly weighted complexes

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Normal approximation for exponential random graphs