Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.

A Modified Uncertain Maximum Likelihood Estimation with Applications in Uncertain Statistics

Uncertain Maximum Likelihood Estimation with Application to Uncertain Regression Analysis

Estimating Unknown Parameters in Uncertain Differential Equation by Maximum Likelihood Estimation

A highly robust estimator through partially likelihood function modeling and its application in computer vision

Estimating Unknown Parameters and Disturbance Term in Uncertain Regression Models by the Principle of Least Squares

Estimation of Uncertainty Distribution Function by the Principle of Least Squares

Least absolute deviations for uncertain multivariate regression model

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A Robust Adaptive Modified Maximum Likelihood Estimator for the Linear Regression Model

Uncertain logistic regression models

Least squares parameter estimation for uncertain fractional differential equations and application to stock model

Maximum Empirical Likelihood Estimation of Continuous-Time Models with Conditional Characteristic Functions

Robust explicit estimation of the log-logistic distribution with applications

Uncertain Hypothesis Test with Application to Uncertain Regression Analysis.

Essential formulae for restricted maximum likelihood and its derivatives associated with the linear mixed models

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Parameter estimation for uncertain fractional differential equations

Maximum Likelihood Estimation by Monte Carlo Simulation: Toward Data-Driven Stochastic Modeling.

Maximum Approximated Likelihood Estimation

Tukey’s biweight estimation for uncertain regression model with imprecise observations

Approximate maximum likelihood estimators for linear regression with design matrix uncertainty