Abstract:Background: Graphical Gaussian models are popular tools for the estimation of (undirected) gene association networks from microarray data. A key issue when the number of variables greatly exceeds the number of samples is the estimation of the matrix of partial correlations. Since the (Moore-Penrose) inverse of the sample covariance matrix leads to poor estimates in this scenario, standard methods are inappropriate and adequate regularization techniques are needed. Popular approaches include biased estimates of the covariance matrix and high-dimensional regression schemes, such as the Lasso and Partial Least Squares. Results: In this article, we investigate a general framework for combining regularized regression methods with the estimation of Graphical Gaussian models. This framework includes various existing methods as well as two new approaches based on ridge regression and adaptive lasso, respectively. These methods are extensively compared both qualitatively and quantitatively within a simulation study and through an application to six diverse real data sets. In addition, all proposed algorithms are implemented in the R package "parcor", available from the R repository CRAN. Conclusion: In our simulation studies, the investigated non-sparse regression methods, i.e. Ridge Regression and Partial Least Squares, exhibit rather conservative behavior when combined with (local) false discovery rate multiple testing in order to decide whether or not an edge is present in the network. For networks with higher densities, the difference in performance of the methods decreases. For sparse networks, we confirm the Lasso's well known tendency towards selecting too many edges, whereas the two-stage adaptive Lasso is an interesting alternative that provides sparser solutions. In our simulations, both sparse and non-sparse methods are able to reconstruct networks with cluster structures. On six real data sets, we also clearly distinguish the results obtained using the non-sparse methods and those obtained using the sparse methods where specification of the regularization parameter automatically means model selection. In five out of six data sets, Partial Least Squares selects very dense networks. Furthermore, for data that violate the assumption of uncorrelated observations (due to replications), the Lasso and the adaptive Lasso yield very complex structures, indicating that they might not be suited under these conditions. The shrinkage approach is more stable than the regression based approaches when using subsampling.

A sparse conditional Gaussian graphical model for analysis of genetical genomics data

Covariate-adjusted Precision Matrix Estimation with an Application in Genetical Genomics

High-Dimensional Gaussian Graphical Regression Models with Covariates

Joint estimation of multiple dependent Gaussian graphical models with applications to mouse genomics

Inferring Novel Associations Between SNP Sets and Gene Sets in Eqtl Study Using Sparse Graphical Model

Fast and Robust Group-Wise Eqtl Mapping Using Sparse Graphical Models

Modelling correlated marker effects in genome-wide prediction via Gaussian concentration graph models

A Log-Linear Graphical Model for Inferring Genetic Networks from High-Throughput Sequencing Data

Integrative Analysis of Genetical Genomics Data Incorporating Network Structures.

Bayesian Sparse Factor Analysis of Genetic Covariance Matrices

Model selection and estimation in the matrix normal graphical model

Assisted estimation of gene expression graphical models.

Introducing Gaussian covariance graph models in genome-wide prediction

A convex formulation of covariate-adjusted Gaussian graphical models via natural parametrization

L1-Penalized Censored Gaussian Graphical Model

A Sparse Graph-Structured Lasso Mixed Model for Genetic Association with Confounding Correction

Uncertainty quantification in high-dimensional linear models incorporating graphical structures with applications to gene set analysis

Regularized estimation of large-scale gene association networks using graphical Gaussian models

Learning Transcriptional Regulatory Relationships Using Sparse Graphical Models

Application of new probabilistic graphical models in the genetic regulatory networks studies

The conditional censored graphical lasso estimator