Abstract:Covariance matrices are fundamental to the analysis and forecast of economic, physical and biological systems. Although the eigenvalues $\{\lambda_i\}$ and eigenvectors $\{{\bf u}_i\}$ of a covariance matrix are central to such endeavors, in practice one must inevitably approximate the covariance matrix based on data with finite sample size $n$ to obtain empirical eigenvalues $\{\tilde{\lambda}_i\}$ and eigenvectors $\{\tilde{\bf u}_i\}$, and therefore understanding the error so introduced is of central importance. We analyze eigenvector error $\|{\bf u}_i - \tilde{\bf u}_i \|^2$ while leveraging the assumption that the true covariance matrix having size $p$ is drawn from a matrix ensemble with known spectral properties---particularly, we assume the distribution of population eigenvalues weakly converges as $p\to\infty$ to a spectral density $\rho(\lambda)$ and that the spacing between population eigenvalues is similar to that for the Gaussian orthogonal ensemble. Our approach complements previous analyses of eigenvector error that require the full set of eigenvalues to be known, which can be computationally infeasible when $p$ is large. To provide a scalable approach for uncertainty quantification of eigenvector error, we consider a fixed eigenvalue $\lambda$ and approximate the distribution of the expected square error $r= \mathbb{E}\left[\| {\bf u}_i - \tilde{\bf u}_i \|^2\right]$ across the matrix ensemble for all ${\bf u}_i$ associated with $\lambda_i=\lambda$. We find, for example, that for sufficiently large matrix size $p$ and sample size $n>p$, the probability density of $r$ scales as $1/nr^2$. This power-law scaling implies that eigenvector error is extremely heterogeneous---even if $r$ is very small for most eigenvectors, it can be large for others with non-negligible probability. We support this and further results with numerical experiments.

On The Error-Estimates Of Correlation-Functions

Measuring the symmetry of model errors for varying coefficient regression models based on correlation coefficient

The effect of error coefficient matrices and correlation criteria on dic computation errors

On The Calculation Of Standard Error For Quotation In Confidence-Statements

Estimators of the correlation coefficient in the bivariate exponential distribution

Ensemble-based estimates of eigenvector error for empirical covariance matrices

Testing Symmetry of Model Errors for Nonparametric Regression Models by Using Correlation Coefficient1

Uniform saddlepoint approximations for ratios of quadratic forms

Sample Correlation Coefficients Based on Survey Data under Regression Imputation

An Improved Estimator for the Correlation Function of 2D Nonlinear Sigma Models

A parametric bootstrap approach for computing confidence intervals for genetic correlations with application to genetically-determined protein-protein networks

Detection of the symmetry of model errors for partial linear single-index models

Asymptotics of resampling without replacement in robust and logistic regression

A Correlation-induced Finite Difference Estimator

Robust Estimating Equations and Bias Correction of Correlation Parameters for Longitudinal Data

On confidence intervals centered on bootstrap smoothed estimators

Precise Error Analysis of Regularized M-estimators in High-dimensions

On the failure of the bootstrap for Chatterjee's rank correlation

On correlation of the 3-fold divisor function with itself

The Student ensemble of correlation matrices: eigenvalue spectrum and Kullback-Leibler entropy

On the Sample Complexity of HGR Maximal Correlation Functions for Large Datasets