Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

On Unbounded Hazard Rates for Smoothed Perturbation Analysis

Approximation of Sums of Locally Dependent Random Variables via Perturbation of Stein Operator

Extensions and Generalizations of Smoothed Perturbation Analysis in A Generalized Semi-Markov Process Framework (vol 37, Pg 1483, 1992)

Nonparametric Estimation of Quantiles for A Class of Stationary Processes

On Bounded Stochastic Processes

Asymptotic Theory for Explosive Fractional Ornstein-Uhlenbeck Processes

On Perturbation Propagation for Smoothed Perturbation Analysis

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Extensions and Generalizations of Smoothed Perturbation Analysis in a Generalized Semi-Markov Process Framework

Linear and quadratic functionals of random hazard rates: An asymptotic analysis

On the Variance of Single-Run Unbiased Stochastic Derivative Estimators.

On quantitative stability in infinite-dimensional optimization under uncertainty

Asymptotic properties of kernel density and hazard rate function estimators with censored widely orthant dependent data

Hazard Rate and Reversed Hazard Rate Orders on Extremes of Heterogeneous and Dependent Random Variables

Smoothing methods to estimate the hazard rate under double truncation

On the Concentration of the Minimizers of Empirical Risks

A flexible model for bounded data with bathtub shaped hazard rate function and applications

Strongly convergent homogeneous approximations to inhomogeneous Markov jump processes and applications

Investigation of finite-sample properties of robust location and scale estimators

Existence of bounded solutions to multiplicative Poisson equations under mixing property