Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Hypothesis Testing with Estimation-Dependent Costs and ∊-Contamination Prior

Nonparametric Estimation for Contamination Distribution

Joint Detection and Parameter Estimation under Unknown Prior Probability

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Bayesian Hypothesis Tests Using Nonparametric Statistics

Robust Hypothesis Testing Using Wasserstein Uncertainty Sets

Optimal estimator for uncertainty-based measurement quality control

Uncertain Hypothesis Test with Application to Uncertain Regression Analysis.

Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing

Estimation and Hypothesis-Testing in Finite Mixture-Models

Pretest estimation in combining probability and non-probability samples

Parameter Estimation and Hypothesis Testing of Two Pareto Populations with Missing Data

Robust Hypothesis Testing with Wasserstein Uncertainty Sets

Estimation beyond Missing (Completely) at Random

Estimation of Proportion of Null Hypotheses Under Dependence

Adaptive Robust Confidence Intervals

Optimal False Discovery Rate Control for Large Scale Multiple Testing with Auxiliary Information

Tractable and Near-Optimal Adversarial Algorithms for Robust Estimation in Contaminated Gaussian Models

Estimating the number and effect sizes of non-null hypotheses

Parameter Estimation and Hypothesis Testing of Two Pareto Distribution with Missing Data

Multiple Hypothesis Testing in Adversarial Environments: A Game-theoretic Approach