Abstract:This paper presents a new performance bound for estimation problems where the parameter to estimate lies in a Riemannian manifold (a smooth manifold endowed with a Riemannian metric) and follows a given prior distribution. In this setup, the chosen Riemannian metric induces a geometry for the parameter manifold, as well as an intrinsic notion of the estimation error measure. Performance bound for such error measure were previously obtained in the non-Bayesian case (when the unknown parameter is assumed to deterministic), and referred to as \textit{intrinsic} Cramér-Rao bound. The presented result then appears either as: \textit{a}) an extension of the intrinsic Cramér-Rao bound to the Bayesian estimation framework; \textit{b}) a generalization of the Van-Trees inequality (Bayesian Cramér-Rao bound) that accounts for the aforementioned geometric structures. In a second part, we leverage this formalism to study the problem of covariance matrix estimation when the data follow a Gaussian distribution, and whose covariance matrix is drawn from an inverse Wishart distribution. Performance bounds for this problem are obtained for both the mean squared error (Euclidean metric) and the natural Riemannian distance for Hermitian positive definite matrices (affine invariant metric). Numerical simulation illustrate that assessing the error with the affine invariant metric is revealing of interesting properties of the maximum a posteriori and minimum mean square error estimator, which are not observed when using the Euclidean metric.

On the theoretic and practical merits of the banding estimator for large covariance matrices

Band Width Selection for High Dimensional Covariance Matrix Estimation

Regularized estimation of large covariance matrices

Test for Bandedness of High-Dimensional Covariance Matrices and Bandwidth Estimation

Performance Bound Approximation for Bearing Estimation with Bias Correction

Forward Adaptive Banding for Estimating Large Covariance Matrices

Optimal Estimation of Structured Covariance Operators

Estimation of Conditional Mean Operator under the Bandable Covariance Structure

Estimation of Large Precision Matrices Through Block Penalization

EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS

A new approach to Cholesky-based covariance regularization in high dimensions

Convergence Rates of Spectral Distributions of Large Sample Covariance Matrices

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

Post-Processed Posteriors for Banded Covariances

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

Intrinsic Bayesian Cramér-Rao Bound with an Application to Covariance Matrix Estimation

Bayesian Bandit Algorithms with Approximate Inference in Stochastic Linear Bandits

Bagging cross-validated bandwidths with application to Big Data

Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits

Performance analysis and optimal selection of large mean-variance portfolios under estimation risk