Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

The Farither Study and Pitman Superiority of Bayes Estimate

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

Superiority of Empirical Bayes Estimation of Error Variance in Linear Model

Linear Bayes estimator of parameters and its superiorities for one-way ANOVA model

Superiorities of Simultaneous Bayes Estimation of Regression Coefficients and Error-Variance in Linear Model

The Superiority of Empirical Bayes Estimator of Parameters in Linear Model

The Superiority of Bayes Linear Unbiased Estimation in the Growth Curve Model

The Superiorities of Empirical Bayes Estimation of Variance Components in Random Effects Model

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

Superiority of Empirical Bayes Estimator of the Mean Vector in Multivariate Normal Distribution

A Summary of Some Research on PC and Bayesian PC Criterion in China

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A Note on the Convergence Rates for Empirical Bayes Estimators of Parameters in Multiple-Parameter Exponential Families

The Robustness of Bayes Linear Unbiased Estimations under Misspecified Prior Assumption

The Superiorities of Bayes Linear Minimum Risk Estimation in Linear Model

Bayesian estimation for longitudinal data in a joint model with HPCs

Empirical Bayes Estimation and Its Superiority for Two-Way Classification Model

The Bayes Estimation of Parameters in Semi-Parametric Regression Model

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

Doubly robust estimation of average treatment effect revisited

Teaching Bayes’ Theorem: Strength of Evidence as Predictive Accuracy