Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

A new multivariate t distribution with variant tail weights and its application in robust regression analysis

Characterization of Multivariate Heavy-Tailed Distribution Families Via Copula

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Tail Index Varying Coefficient Model

The multivariate tail-inflated normal distribution and its application in finance

Empirical Likelihood Based Inference for Conditional Pareto-type Tail Index

A new distribution for robust least squares

A Multivariate Skew-Normal-Tukey-h Distribution

On the Conditional Distribution of the Multivariate $t$ Distribution

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Functional Mapping of Dynamic Traits with Robust T-Distribution

Type-I heavy tailed family with applications in medicine, engineering and insurance

t distribution-based robust semiparametric mixture regression model

ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Clustering using skewed multivariate heavy tailed distributions with flexible tail behaviour

ML-ESTIMATION OF THE T-DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME

Mastering the Body and Tail Shape of a Distribution

Generalized Logistic Models and its orthant tail dependence

Robustness and accuracy of methods for high dimensional data analysis based on Student's t statistic

Robust functional regression model for marginal mean and subject-specific inferences

The t copula with Multiple Parameters of Degrees of Freedom: Bivariate Characteristics and Application to Risk Management