Abstract:The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either chosen heuristically - without compelling theoretical justification - or optimally in view of restrictive distributional assumptions. In this paper, we propose a principled approach to construct covariance estimators without imposing restrictive assumptions. That is, we study distributionally robust covariance estimation problems that minimize the worst-case Frobenius error with respect to all data distributions close to a nominal distribution, where the proximity of distributions is measured via a divergence on the space of covariance matrices. We identify mild conditions on this divergence under which the resulting minimizers represent shrinkage estimators. We show that the corresponding shrinkage transformations are intimately related to the geometrical properties of the underlying divergence. We also prove that our robust estimators are efficiently computable and asymptotically consistent and that they enjoy finite-sample performance guarantees. We exemplify our general methodology by synthesizing explicit estimators induced by the Kullback-Leibler, Fisher-Rao, and Wasserstein divergences. Numerical experiments based on synthetic and real data show that our robust estimators are competitive with state-of-the-art estimators.

A Shrinkage Approach to Joint Estimation of Multiple Covariance Matrices

A Non-Parametric Shrinkage Mean Estimation for Arbitrary Quadratic Loss Functions and Unknown Covariance Matrices

Non-parametric Shrinkage Mean Estimation for Quadratic Loss Functions with Unknown Covariance Matrices

Cross-Validated Tuning of Shrinkage Factors for MVDR Beamforming Based on Regularized Covariance Matrix Estimation

Shrinkage MMSE estimators of covariances beyond the zero-mean and stationary variance assumptions

Shrinkage Estimation of the Power Spectrum Covariance Matrix

Bayesian Covariance Estimation for Multi-group Matrix-variate Data

Target selection in shrinkage estimation of covariance matrix: A structural similarity approach

Eigenvector distributions and optimal shrinkage estimators for large covariance and precision matrices

Multi-Target Shrinkage

Nonparametric Stein-type shrinkage covariance matrix estimators in high-dimensional settings

Shrinkage estimation of large covariance matrices using multiple shrinkage targets

A Class of Optimal Estimators for the Covariance Operator in Reproducing Kernel Hilbert Spaces

Shrinkage Estimation for the Diagonal Multivariate Exponential Families

Multivariate Sparse Laplacian Shrinkage for Joint Estimation of Two Graphical Structures

Analysis of a multi-target linear shrinkage covariance estimator

A shrinkage estimation for large dimensional precision matrices using random matrix theory

A Geometric Unification of Distributionally Robust Covariance Estimators: Shrinking the Spectrum by Inflating the Ambiguity Set

On the Strong Convergence of the Optimal Linear Shrinkage Estimator for Large Dimensional Covariance Matrix

Large-Scale Shrinkage Estimation under Markovian Dependence

Covariance Matrix Analysis for Optimal Portfolio Selection