Abstract:Correlation based graphical models are developed to detect the dependence relationships among random variables and provide intuitive explanations for these relationships in complex systems. Most of the existing works focus on learning a single correlation based graphical model for all the random variables. However, it is difficult to understand and interpret the massive dependencies of the variables learned from a single graphical model at a global level especially when the graph is large. In order to provide a clearer understanding for the dependence relationships among a large number of random variables, in this paper, we propose the problem of estimating an overlapping decomposition for the Gaussian graphical model of a large scale to generate overlapping sub-graphical models, where strong and meaningful correlations remain in each subgraph with a small scale. Specifically, we propose a greedy algorithm to achieve the overlapping decomposition for the Gaussian graphical model. A key technique of the algorithm is that the problem of solving a (k + 1)-node Gaussian graphical model can be approximately reduced to the problem of solving a one-step vector regularization problem based on a solved k-node Gaussian graphical model with theoretical guarantee. Based on this technique, a greedy expansion algorithm is proposed to generate the overlapping subgraphs. Moreover, we extend the proposed method to deal with dynamic graphs where the dependence relationships among random variables vary with the time. We evaluate the proposed methods on synthetic dataset and a real-life traffic dataset, and the experimental results show the superiority of the proposed methods.

Correlation between Multivariate Datasets, from Inter-Graph Distance computed using Graphical Models Learnt With Uncertainties

A Bayesian Approach to Joint Estimation of Multiple Graphical Models

Bayesian multiple Gaussian graphical models for multilevel variables from unknown classes

Multivariate Generalised Linear Mixed Models With Graphical Latent Covariance Structure

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Joint estimation of multiple high-dimensional Gaussian copula graphical models

Joint Mean and Correlation Regression Models for Multivariate Data

Covariance approximation for large multivariate spatial data sets with an application to multiple climate model errors

Bayesian Learning in Undirected Graphical Models: Approximate MCMC algorithms

High-Dimensional Joint Estimation of Multiple Directed Gaussian Graphical Models

Global multivariate model learning from hierarchically correlated data

A Novel Multiview Topic Model to Compute Correlation of Heterogeneous Data

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

Bayesian Nonparametric Modelling of Conditional Multidimensional Dependence Structures

Uncertainty quantification in high-dimensional linear models incorporating graphical structures with applications to gene set analysis

Unbiased Multivariate Correlation Analysis.

Simultaneous clustering and estimation of networks in multiple graphical models

Joint Estimation and Inference for Data Integration Problems based on Multiple Multi-layered Gaussian Graphical Models

Learning High-Dimensional Differential Graphs From Multi-Attribute Data

Overlapping Decomposition for Gaussian Graphical Modeling

Joint estimation of multiple dependent Gaussian graphical models with applications to mouse genomics