Abstract:Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse problem with a smoothness promoting objective and rely on iterative methods to obtain a solution. In supervised settings where graph labels are available, one can unroll and truncate these iterations into a deep network that is trained end-to-end. Such a network is parameter efficient and inherits inductive bias from the optimization formulation, an appealing aspect for data constrained settings in, e.g., medicine, finance, and the natural sciences. But typically such settings care equally about uncertainty over edge predictions, not just point estimates. Here we introduce novel iterations with independently interpretable parameters, i.e., parameters whose values - independent of other parameters' settings - proportionally influence characteristics of the estimated graph, such as edge sparsity. After unrolling these iterations, prior knowledge over such graph characteristics shape prior distributions over these independently interpretable network parameters to yield a Bayesian neural network (BNN) capable of graph structure learning (GSL) from smooth signal observations. Fast execution and parameter efficiency allow for high-fidelity posterior approximation via Markov Chain Monte Carlo (MCMC) and thus uncertainty quantification on edge predictions. Synthetic and real data experiments corroborate this model's ability to provide well-calibrated estimates of uncertainty, in test cases that include unveiling economic sector modular structure from S$\&$P$500$ data and recovering pairwise digit similarities from MNIST images. Overall, this framework enables GSL in modest-scale applications where uncertainty on the data structure is paramount.

Bayesian learning of forest and tree graphical models

Bayesian Learning in Undirected Graphical Models: Approximate MCMC algorithms

Bayesian graph selection consistency under model misspecification

Bayesian Spatial Analysis of Hardwood Tree Counts in Forests via MCMC

RJHMC-Tree for Exploration of the Bayesian Decision Tree Posterior

Bayesian Out-Trees

Learning Nonparametric Forest Graphical Models With Prior Information

Bayesian Decision Trees via Tractable Priors and Probabilistic Context-Free Grammars

Non-Parametric Graph Learning for Bayesian Graph Neural Networks

Variational Bayesian Methods for a Tree-Structured Stick-Breaking Process Mixture of Gaussians by Application of the Bayes Codes for Context Tree Models

Bayesian network structures learning based on approach using incoporate priors method

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Parallel Sampling of Decomposable Graphs Using Markov Chains on Junction Trees

Learning High-Dimensional Markov Forest Distributions: Analysis of Error Rates

Bayesian learning of multiple directed networks from observational data

Bayesian Method for Learning Graphical Models with Incompletely Categorical Data

Parallel sampling of decomposable graphs using Markov chain on junction trees

Bayesian Joint Spike-and-Slab Graphical Lasso

Structural learning of simple staged trees

Graph Structure Learning with Interpretable Bayesian Neural Networks

Bayesian clustering in decomposable graphs