Abstract:Network estimation has been a critical component of high-dimensional data analysis and can provide an understanding of the underlying complex dependence structures. Among the existing studies, Gaussian graphical models have been highly popular. However, they still have limitations due to the homogeneous distribution assumption and the fact that they are only applicable to small-scale data. For example, cancers have various levels of unknown heterogeneity, and biological networks, which include thousands of molecular components, often differ across subgroups while also sharing some commonalities. In this article, we propose a new joint estimation approach for multiple networks with unknown sample heterogeneity, by decomposing the Gaussian graphical model (GGM) into a collection of sparse regression problems. A reparameterization technique and a composite minimax concave penalty are introduced to effectively accommodate the specific and common information across the networks of multiple subgroups, making the proposed estimator significantly advancing from the existing heterogeneity network analysis based on the regularized likelihood of GGM directly and enjoying scale-invariant, tuning-insensitive, and optimization convexity properties. The proposed analysis can be effectively realized using parallel computing. The estimation and selection consistency properties are rigorously established. The proposed approach allows the theoretical studies to focus on independent network estimation only and has the significant advantage of being both theoretically and computationally applicable to large-scale data. Extensive numerical experiments with simulated data and the TCGA breast cancer data demonstrate the prominent performance of the proposed approach in both subgroup and network identifications.

Estimation of multiple networks in Gaussian mixture models.

Estimation of Multiple Networks with Common Structures in Heterogeneous Subgroups.

Simultaneous clustering and estimation of networks in multiple graphical models

On Joint Estimation of Gaussian Graphical Models for Spatial and Temporal Data

Simultaneous Estimation of Many Sparse Networks via Hierarchical Poisson Log-Normal Model

Generalized Precision Matrix for Scalable Estimation of Nonparametric Markov Networks

Joint estimation of multiple dependent Gaussian graphical models with applications to mouse genomics

Gaussian Graphical Model Estimation and Selection for High-Dimensional Incomplete Data Using Multiple Imputation and Horseshoe Estimators

Bayesian multiple Gaussian graphical models for multilevel variables from unknown classes

High-Dimensional Joint Estimation of Multiple Directed Gaussian Graphical Models

Joint Estimation Of Multiple High-Dimensional Precision Matrices

Joint estimation of multiple high-dimensional Gaussian copula graphical models

Multiple-Model Estimation With Heterogeneous State Representation

Sequential Estimation for Mixture of Regression Models for Heterogeneous Population

Estimating Mixture of Gaussian Processes by Kernel Smoothing

Gaussian Mixture Reduction for Time-Constrained Approximate Inference in Hybrid Bayesian Networks

An Effective EM Algorithm for Mixtures of Gaussian Processes Via the MCMC Sampling and Approximation.

Joint Estimation and Inference for Data Integration Problems based on Multiple Multi-layered Gaussian Graphical Models

Network Biomarker Detection from Gene Co-Expression Network Using Gaussian Mixture Model Clustering.

NJGCG: A node-based joint Gaussian copula graphical model for gene networks inference across multiple states

Two-sample inference for high-dimensional Markov networks