Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

A New Unbiased Stochastic Derivative Estimator for Discontinuous Sample Performances with Structural Parameters.

Identification of nonlinearly parameterized nonlinear models: application to mass balance systems.

Estimation and Inference in Fractional Ornstein–Uhlenbeck Model with Discrete-Sampled Data∗

Generalized Likelihood Ratio Method for Stochastic Models with Uniform Random Numbers As Inputs

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

Optimal Estimation of Derivatives in Nonparametric Regression

On the Variance of Single-Run Unbiased Stochastic Derivative Estimators.

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A framework to select tuning parameters for nonparametric derivative estimation

Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

Non-intrusive Stochastic Analysis with Parameterized Imprecise Probability Models: I. Performance Estimation

Stochastic derivative estimation for max-stable random fields

Optimized Regression Discontinuity Designs

An Efficient High-Dimensional Gradient Estimator for Stochastic Differential Equations

Parameter Estimation for Multivariate Nonlinear Stochastic Differential Equation Models: A Comparison Study

Parameter Estimation in Stochastic Differential Equations

An Adaptive Hybrid Dimension-Reduction Model and Its Application for Statistical Moments Estimation of Stochastic Systems and Reliability Analysis of Structures

Parameter Estimation in Nonlinear Multivariate Stochastic Differential Equations Based on Splitting Schemes

Derivative-Free Optimization via Adaptive Sampling Strategies

Direct Estimation of the Mean Outcome on Treatment when Treatment Assignment and Discontinuation Compete

Non-intrusive Stochastic Analysis with Parameterized Imprecise Probability Models: II. Reliability and Rare Events Analysis