Abstract:Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal entries of covariance matrices and put a positive definite constraint on matrices. In this paper, we consider a spike and slab prior on off-diagonal entries, which uses a mixture of point-mass and normal distribution. The point-mass naturally introduces sparsity to covariance structures so that the resulting posterior from this prior renders covariance structure learning. Under this prior, we calculate posterior model probabilities of covariance structures using Laplace approximation. We show that the error due to Laplace approximation becomes asymptotically marginal at some rate depending on the posterior convergence rate of covariance matrix under the Frobenius norm. With the approximated posterior model probabilities, we propose a new framework for estimating a covariance structure. Since the Laplace approximation is done around the mode of conditional posterior of covariance matrix, which cannot be obtained in the closed form, we propose a block coordinate descent algorithm to find the mode and show that the covariance matrix can be estimated using this algorithm once the structure is chosen. Through a simulation study based on five numerical models, we show that the proposed method outperforms graphical lasso and sample covariance matrix in terms of root mean squared error, max norm, spectral norm, specificity, and sensitivity. Also, the advantage of the proposed method is demonstrated in terms of accuracy compared to our competitors when it is applied to linear discriminant analysis (LDA) classification to breast cancer diagnostic dataset.

Estimation for the Linear Model with Uncertain Covariance Matrices

Approximate maximum likelihood estimators for linear regression with design matrix uncertainty

Maximum A Posteriori Covariance Estimation Using a Power Inverse Wishart Prior

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Estimating linear covariance models with numerical nonlinear algebra

Adaptive Maximum Correntropy Based Robust CKF with Variational Bayesian for Covariance Estimation

Covariance Structure Estimation with Laplace Approximation

Nonlinear Recursive Minimum Model Error Estimation

Asymptotic Form of the Covariance Matrix of Likelihood-Based Estimator in Multidimensional Linear System Model for the Case of Infinity Number of Nuisance Parameters

Bayesian inference for a covariance matrix

Entropic covariance models

A Moving Horizon Estimation Approach To Constrained Linear System With Uncertain Model

Sparse estimation of a covariance matrix

Estimation in Covariance Components Models

Covariance Matrix Estimation Via Network Structure

Bayesian estimation of cluster covariance matrices of unknown form

Semiparametric Model for Covariance Regression Analysis.

Posterior asymptotics of high-dimensional spiked covariance model with inverse-Wishart prior

Robust Mse Estimation for Linear Gaussian Model with Uncertainties

Minimum Variance Estimation for Linear Uncertain Systems with One-Step Correlated Noises and Incomplete Measurements

Optimal portfolio allocation with uncertain covariance matrix