Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Central Limit Theorems for Weighted Quadratic Forms of Dependent Processes with Applications in Specification Testing

Central Limit Theorems for Generalizedu-Statistics with Applications in Nonparametric Specification

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

On Central Limit Theorems for Vector Random Measures and Measure-Valued Processes

Almost sure central limit theorems for functionals of absolutely regular processes with application to U-statistics

Almost Sure Functional Central Limit Theorems for Weakly Dependent Sequences

LIMIT BEHAVIORS FOR THE INCREMENTS OF A D-Dimensional MULTI-PARAMETER GAUSSIAN PROCESS

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Central limit theorems for high dimensional dependent data

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Asymptotics for A Class of Dependent Random Variables

Central Limit Theorems for Asymptotically Negatively Associated Random Fields

Estimation and Inference in the Presence of Fractional d=1/2 and Weakly Nonstationary Processes

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Strong laws for weighted sums of widely orthant dependent random variables and applications

Conditional Independence Specification Testing for Dependent Processes with Local Polynomial Quantile Regression

A central limit theorem for generalized quadratic forms

Limit Theorems in Change-Point Problems with Multivariate Long-Range Dependent Observations

Note on Strong Convergence Properties of Generalized Jamison's Weighted Sums for Pairwise Negatively Quadrant Dependent(NQD) Random Variables

Probabilistic limit behaviors of numerical discretizations for time-homogeneous Markov processes

Functional central limit theorem for negatively dependent heavy-tailed stationary infinitely divisible processes generated by conservative flows