Abstract:Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal entries of covariance matrices and put a positive definite constraint on matrices. In this paper, we consider a spike and slab prior on off-diagonal entries, which uses a mixture of point-mass and normal distribution. The point-mass naturally introduces sparsity to covariance structures so that the resulting posterior from this prior renders covariance structure learning. Under this prior, we calculate posterior model probabilities of covariance structures using Laplace approximation. We show that the error due to Laplace approximation becomes asymptotically marginal at some rate depending on the posterior convergence rate of covariance matrix under the Frobenius norm. With the approximated posterior model probabilities, we propose a new framework for estimating a covariance structure. Since the Laplace approximation is done around the mode of conditional posterior of covariance matrix, which cannot be obtained in the closed form, we propose a block coordinate descent algorithm to find the mode and show that the covariance matrix can be estimated using this algorithm once the structure is chosen. Through a simulation study based on five numerical models, we show that the proposed method outperforms graphical lasso and sample covariance matrix in terms of root mean squared error, max norm, spectral norm, specificity, and sensitivity. Also, the advantage of the proposed method is demonstrated in terms of accuracy compared to our competitors when it is applied to linear discriminant analysis (LDA) classification to breast cancer diagnostic dataset.

Notes on asymptotics of sample eigenstructure for spiked covariance models with non-Gaussian data

Joint CLT for Several Random Sesquilinear Forms with Applications to Large-Dimensional Spiked Population Models

The Asymptotic Properties of the Extreme Eigenvectors of High-dimensional Generalized Spiked Covariance Model

Asymptotic Theory of Eigenvectors for Random Matrices with Diverging Spikes

Asymptotic distribution of spiked eigenvalues in the large signal-plus-noise models

Statistical inference for principal components of spiked covariance matrices

Limiting laws for divergent spiked eigenvalues and largest nonspiked eigenvalue of sample covariance matrices

A Note on the CLT of the LSS for Sample Covariance Matrix from a Spiked Population Model

Asymptotic Linear Spectral Statistics for Spiked Hermitian Random Matrix Models

On asymptotics of eigenvectors of large sample covariance matrix

A Unified Framework For Change Point Detection In High-Dimensional Linear Models

Detecting Spectral Breaks in Spiked Covariance Models

Limiting laws and consistent estimation criteria for fixed and diverging number of spiked eigenvalues

Large deviations for spectral measures of some spiked matrices

On spiked eigenvalues of a renormalized sample covariance matrix from multi-population

Inference on testing the number of spikes in a high-dimensional generalized two-sample spiked model and its applications

Spiked eigenvalues of high-dimensional sample autocovariance matrices: CLT and applications

Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise

No Statistical-Computational Gap in Spiked Matrix Models with Generative Network Priors

High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models

Covariance Structure Estimation with Laplace Approximation