Abstract:A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic samples, referred to as outliers. Building upon recent random matrix advances in the area of robust statistics, we specifically show that the so-called Maronna M-estimator of scatter asymptotically behaves similar to well-known random matrices when the population and sample sizes grow together to infinity. The introduction of outliers leads the robust estimator to behave asymptotically as the weighted sum of the sample outer products, with a constant weight for all legitimate samples and different weights for the outliers. A fine analysis of this structure reveals importantly that the propensity of the M-estimator to attenuate (or enhance) the impact of outliers is mostly dictated by the alignment of the outliers with the inverse population covariance matrix of the legitimate samples. Thus, robust M-estimators can bring substantial benefits over more simplistic estimators such as the per-sample normalized version of the sample covariance matrix, which is not capable of differentiating the outlying samples. The analysis shows that, within the class of Maronna's estimators of scatter, the Huber estimator is most favorable for rejecting outliers. On the contrary, estimators more similar to Tyler's scale invariant estimator (often preferred in the literature) run the risk of inadvertently enhancing some outliers.

Robustifying multiple-set linear canonical analysis with S-estimator

Heteroskedasticity-robust inference in linear regression models with many covariates

A robust method for canonical correlation analysis

Robust Covariance Estimation for Distributed Principal Component Analysis

Robust Estimation of Measurement Error Covariance

Large Dimensional Analysis of Robust M-Estimators of Covariance with Outliers

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Spatial local M-estimation under association

A Geometric Unification of Distributionally Robust Covariance Estimators: Shrinking the Spectrum by Inflating the Ambiguity Set

Robust estimation in a nonlinear cointegration model

Robust smoothed canonical correlation analysis for functional data

Statistical Inference for a Robust Measure of Multiple Correlation

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Uniform bounds for robust mean estimators

Constrained ERM Learning of Canonical Correlation Analysis: A Least Squares Perspective

A cautionary note on robust covariance plug-in methods

Bounded-Influence Robust Estimation in Generalized Linear Latent Variable Models

Locally robust inference for non-Gaussian linear simultaneous equations models

Robust covariance estimation and explainable outlier detection for matrix-valued data

Robust Bayesian small area estimation using the sub-Gaussian -stable distribution for measurement error in covariates

Shrinkage MMSE estimators of covariances beyond the zero-mean and stationary variance assumptions