Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

DEPENDENT ROBUST ESTIMATION AND ITS APPLICATIONS IN SURVEY DATA PROCESSING

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust State Estimation For Systems with Uncertainties of Unknown Bound

THE METHOD OF RANK-BASED ROBUST REGRESSION ANALYSIS

Robust Estimation of Measurement Error Covariance

Study on Variogram Robustness

Unified robust estimation

Robust estimation of the generalised partial linear model with missing covariates

Robust State Estimation for Uncertain Discrete-Time Stochastic Systems with Missing Measurements

Robust estimation in linear regression models for longitudinal data with covariate measurement errors and outliers

Robust estimation of panel data regression models and applications

Asymptotic equivalence and adaptive estimation for robust nonparametric regression

Study of the Robust Estimation Method of Inter-Satellite Ranging Network

Robust regression based on shrinkage estimators

Robust Estimation for Function-on-scalar Regression Models

Rank-based Robust Regression Method

Robust Wasserstein Optimization and its Application in Mean-CVaR

Robust estimation in joint mean–covariance regression model for longitudinal data

Robust estimations from distribution structures: I. Mean

Non-Asymptotic Guarantees for Robust Statistical Learning under Infinite Variance Assumption

Robust small area estimation for unit level model with density power divergence