Abstract:In multivariate statistics, the question of finding direct interactions can be formulated as a problem of network inference - or network reconstruction - for which the Gaussian graphical model (GGM) provides a canonical framework. Unfortunately, the Gaussian assumption does not apply to count data which are encountered in domains such as genomics, social sciences or ecology. To circumvent this limitation, state-of-the-art approaches use two-step strategies that first transform counts to pseudo Gaussian observations and then apply a (partial) correlation-based approach from the abundant literature of GGM inference. We adopt a different stance by relying on a latent model where we directly model counts by means of Poisson distributions that are conditional to latent (hidden) Gaussian correlated variables. In this multivariate Poisson lognormal-model, the dependency structure is completely captured by the latent layer. This parametric model enables to account for the effects of covariates on the counts. To perform network inference, we add a sparsity inducing constraint on the inverse covariance matrix of the latent Gaussian vector. Unlike the usual Gaussian setting, the penalized likelihood is generally not tractable, and we resort instead to a variational approach for approximate likelihood maximization. The corresponding optimization problem is solved by alternating a gradient ascent on the variational parameters and a graphical-Lasso step on the covariance matrix. We show that our approach is highly competitive with the existing methods on simulation inspired from microbiological data. We then illustrate on three various data sets how accounting for sampling efforts via offsets and integrating external covariates (which is mostly never done in the existing literature) drastically changes the topology of the inferred network.

Sparse Hopfield network reconstruction with $\ell_{1}$ regularization

Structure Learning in Inverse Ising Problems Using ℓ_2-Regularized Linear Estimator

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

A new mechanical approach to handle generalized Hopfield neural networks

Reconstructing the Hopfield network as an inverse Ising problem

Distributed Sparse Recursive Least-Squares over Networks

Nonparametric Modern Hopfield Models

Does the $\ell_1$-norm Learn a Sparse Graph under Laplacian Constrained Graphical Models?

Variational inference for sparse network reconstruction from count data

Sparsity promoting hybrid solvers for hierarchical Bayesian inverse problems

Sparse and Structured Hopfield Networks

Sparse reconstructions from few noisy data: analysis of hierarchical Bayesian models with generalized gamma hyperpriors

Learning a Gaussian Mixture for Sparsity Regularization in Inverse Problems

Sparse dynamic network reconstruction through L1-regularization of a Lyapunov equation

On Sparse Modern Hopfield Model

Simultaneously Sparse and Low-Rank Matrix Reconstruction Via Nonconvex and Nonseparable Regularization

Sparse Nonlinear Regression: Parameter Estimation and Asymptotic Inference

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

A Proximal-Gradient Homotopy Method for the Sparse Least-Squares Problem

Efficient sparse probability measures recovery via Bregman gradient

Inference and learning in sparse systems with multiple states