Abstract:Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal entries of covariance matrices and put a positive definite constraint on matrices. In this paper, we consider a spike and slab prior on off-diagonal entries, which uses a mixture of point-mass and normal distribution. The point-mass naturally introduces sparsity to covariance structures so that the resulting posterior from this prior renders covariance structure learning. Under this prior, we calculate posterior model probabilities of covariance structures using Laplace approximation. We show that the error due to Laplace approximation becomes asymptotically marginal at some rate depending on the posterior convergence rate of covariance matrix under the Frobenius norm. With the approximated posterior model probabilities, we propose a new framework for estimating a covariance structure. Since the Laplace approximation is done around the mode of conditional posterior of covariance matrix, which cannot be obtained in the closed form, we propose a block coordinate descent algorithm to find the mode and show that the covariance matrix can be estimated using this algorithm once the structure is chosen. Through a simulation study based on five numerical models, we show that the proposed method outperforms graphical lasso and sample covariance matrix in terms of root mean squared error, max norm, spectral norm, specificity, and sensitivity. Also, the advantage of the proposed method is demonstrated in terms of accuracy compared to our competitors when it is applied to linear discriminant analysis (LDA) classification to breast cancer diagnostic dataset.

Bayesian Local Influence for the Growth Curve Model with Rao's Simple Covariance Structure

Bayesian influence diagnostics using normalizing functional Bregman divergence

Bayesian analysis for nonlinear regression model under skewed errors, with application in growth curves

Bayesian inference of a non-local proliferation model

Bayesian Inference and Application of Robust Growth Curve Models Using Student'S T Distribution

Bayesian Influence Analysis of the Skew-Normal Spatial Autoregression Models

Covariance Structure Estimation with Laplace Approximation

Scalable Bayesian High-dimensional Local Dependence Learning

Bayesian diagnostics in a partially linear model with first-order autoregressive skew-normal errors

The Behavior and Convergence of Local Bayesian Optimization

Bayesian estimation for longitudinal data in a joint model with HPCs

Bayesian Approach to Linear Bayesian Networks

Bayesian Nonparametric Regression Analysis of Data with Random Effects Covariates from Longitudinal Measurements

Bayesian Analysis Of Longitudinal Data Using Growth Curve Models

Modeling Error Distributions of Growth Curve Models Through Bayesian Methods.

Bayesian Registration of Functions and Curves

Local Influence Analysis for Penalized Gaussian Likelihood Estimators in Partially Linear Models

Comparison of Inverse Wishart and Separation-Strategy Priors for Bayesian Estimation of Covariance Parameter Matrix in Growth Curve Analysis

A Bayesian approach to model individual differences and to partition individuals: case studies in growth and learning curves

Bayesian Approach to Non-ignorable Missingness in Latent Growth Models

Influence diagnostics in Birnbaum-Saunders nonlinear regression models