Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

On Convergence Properties of a Sensitivity Penalization Based Robust State Estimator

On Asymptotic Behaviors of a Sensitivity Penalization Based Robust State Estimator

Sensitivity Penalization Based Robust State Estimation for Uncertain Linear Systems.

On the Convergence and Stability of a Robust State Estimator.

Robust State Estimation Using Error Sensitivity Penalizing

ROBUST STABILIZATION WITH DEFINITE ATTENUANCE OF LINEAR UNCERTAIN TIME-DELAY SYSTEMS

Robust stabilization of uncertain time-varying discrete systems and comments on "an improved approach for constrained robust model predictive control

Asymptotic Behavior of the Pseudo-Covariance Matrix of a Robust State Estimator with Intermittent Measurements

Robust State Estimation For Systems with Uncertainties of Unknown Bound

Robust State Estimation for Uncertain Discrete-Time Stochastic Systems with Missing Measurements

Robust State Estimation for Uncertain Linear Systems with Deterministic Input Signals

Robust State Estimation for Uncertain Linear Systems with Random Parametric Uncertainties

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Asymptotic Behavior of Recursive State Estimations with Intermittent Measurements

A Note on the Consistency of a Robust Estimator for Threshold Autoregressive Processes

On Stability and Convergence of Suboptimal Estimation for Systems over Lossy Networks Without Acknowledgement

Robust Stabilization for Uncertain Discrete Singular Systems with State Delay

Robust parameter estimation of regression models under weakened moment assumptions

A Robust Strictly Passive Output—Error Identifier for Continuous—Time Systems

Stochastic Approximation of Smooth and Strongly Convex Functions: Beyond the Convergence Rate