Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Robust Estimation of Bivariate Tail Dependence Coefficient

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Divergence based robust estimation of the tail index through an exponential regression model

Robust estimation of Pareto-type tail index through an exponential regression model

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A new estimator for the tail-dependence coefficient

Robust Inference under the Beta Regression Model with Application to Health Care Studies

Nonparametric estimator of the tail dependence coefficient: balancing bias and variance

Robust Estimation Using Modified Huber's Functions with New Tails.

Weighted Estimation of the Dependence Function for an Extreme-Value Distribution

Modeling of Censored Bivariate Extremal Events

Robust parametric inference for finite Markov chains

A Note on Tail Dependence Regression

Interval Estimation for a Measure of Tail Dependence

Robust Estimation of the Tail Index of a Single Parameter Pareto Distribution from Grouped Data

Tail Dependence Measure for Examining Financial Extreme Co-Movements

Reduced-bias estimation of the residual dependence index with unnamed marginals

Robust Estimation in Regression and Classification Methods for Large Dimensional Data

Robust estimations from distribution structures: I. Mean

Likelihood Inference for Factor Copula Models with Asymmetric Tail Dependence