Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

A Statistical Theory for the Analysis of Uncertain Systems

A New Statistical Approach for the Analysis of Uncertain Systems

Probabilistic Robustness Analysis—Risks, Complexity, and Algorithms

Analysis of structural robustness with non-probabilistic uncertainties

Order Statistics and Probabilistic Robust Control

Constrained Robustness Analysis by Randomized Algorithms

Fast Universal Algorithms for Robustness Analysis

Fast Randomized Algorithms for Probabilistic Robustness Analysis

A New Probabilistic Robust Control Approach for System with Uncertain Parameters

Risk Analysis in Robust Control - Making the Case for Probabilistic Robust Control.

New Techniques for Robustness Analysis

A probabilistic approach to robust control

Probabilistic Robustness Analysis of Uncertain Control Systems Using Adaptive Importance Sampling

Sample Reuse Techniques for Probabilistic Robust Control

Technical Communique: On the binomial confidence interval and probabilistic robust control

Robustness analysis of uncertain linear systems with guaranteed cost control

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust stability for sampled-data systems with structured uncertainty

Sample Reuse Techniques of Randomized Algorithms for Control under Uncertainty

Robust Control Against Uncertainty Quartet: A Polynomial Approach

Fault Detection of Uncertain Systems Based on Probabilistic Robustness Theory