Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Robust estimation in finite population sampling

Improved Ratio Estimators Using Some Robust Measures

Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Enhanced Estimation of Population Mean in the Presence of Auxiliary Information

Optimized estimation for population mean using conventional and non-conventional measures under the joint influence of measurement error and non-response

Compromised imputation based mean estimators using robust quantile regression

On Improved Estimation of Population Mean Using Known Coefficient of Skewness of an Auxiliary Variable

Bayesian Robustness to Outliers in Linear Regression and Ratio Estimation

Robust estimations from distribution structures: I. Mean

Uniform bounds for robust mean estimators

On Estimation of Finite Population Proportion

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust Inference under the Beta Regression Model with Application to Health Care Studies

Robust Estimation in Stochastic Frontier Models

Robust Estimation of Measurement Error Covariance

Investigation of finite-sample properties of robust location and scale estimators

The Broader Landscape of Robustness in Algorithmic Statistics

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Double Exponential Ratio Estimator of a Finite Population Variance under Extreme Values in Simple Random Sampling

Robust explicit estimators using the power-weighted repeated medians

Robust Estimation of Bivariate Tail Dependence Coefficient