Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

UNIFORM BAHADUR REPRESENTATION FOR LOCAL POLYNOMIAL ESTIMATES OF M-REGRESSION AND ITS APPLICATION TO THE ADDITIVE MODEL

Bahadur Representation of Nonparametric M-Estimators for Spatial Processes

Nonparametric M-estimation for Functional Stationary Ergodic Data

Local Linear M‐estimation in Non‐parametric Spatial Regression

Local Linear M-Estimators in Null Recurrent Time Series

Local linear M-estimation for spatial processes in fixed-design models

Strong Uniform Convergence of the Recursive Regression Estimator under Φ-Mixing Conditions

Bahadur Representation of Linear Kernel Quantile Estimator for Stationary Processes

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

M robustified additive nonparametric regression

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Multivariate Universal Local Linear Kernel Estimators in Nonparametric Regression: Uniform Consistency

Local M-Estimation for Jump-Diffusion Processes

Deterministic Inequalities for Smooth M-estimators

Strong Consistency of the Internal Estimator of Nonparametric Regression with Dependent Data

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Simultaneous Nonparametric Inference of M-regression under Complex Temporal Dynamics

Semiparametric Mixture Regression with Unspecified Error Distributions

A Note on the Backfitting Estimation of Additive Models

M-estimation for linear models with exchangeable errors

Local Polynomial Estimation of Nonparametric Simultaneous Equations Models