Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

Smoothed Block Empirical Likelihood for Quantiles of Weakly Dependent Processes

Empirical Likelihood Inference for Probability Density Functions under Association

Nonparametric Estimation of Quantiles for A Class of Stationary Processes

Empirical Likelihood for Partial Linear Models under Negatively Associated Errors

Empirical Euclidean Likelihood for General Estimating Equations under Association Dependence

Empirical Likelihood Inference for Nonparametric Regression Functions with Functional Stationary Ergodic Data

Smoothed Empirical Likelihood Confidence Intervals for Quantiles

Empirical Likelihood Inference for Diffusion Processes with Jumps

Empirical Likelihood Based Inference for Conditional Pareto-type Tail Index

Quantile Regression Based on the Weighted Approach with Dependent Truncated Data

Central Limit Theorems for Weighted Quadratic Forms of Dependent Processes with Applications in Specification Testing

Empirical likelihood for quantile regression models with longitudinal data

Empirical Likelihood Confidence Intervals for Nonparametric Density Estimation

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Conditional Empirical Likelihood for Quantile Regression Models

Bahadur Representation of Linear Kernel Quantile Estimator for Stationary Processes

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

A Simple Estimator for Quantile Panel Data Models Using Smoothed Quantile Regressions

Communication-efficient estimation and inference for high-dimensional quantile regression based on smoothed decorrelated score

Empirical Likelihood Confidence Intervals for Local Linear Smoothers