Abstract:Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse problem with a smoothness promoting objective and rely on iterative methods to obtain a solution. In supervised settings where graph labels are available, one can unroll and truncate these iterations into a deep network that is trained end-to-end. Such a network is parameter efficient and inherits inductive bias from the optimization formulation, an appealing aspect for data constrained settings in, e.g., medicine, finance, and the natural sciences. But typically such settings care equally about uncertainty over edge predictions, not just point estimates. Here we introduce novel iterations with independently interpretable parameters, i.e., parameters whose values - independent of other parameters' settings - proportionally influence characteristics of the estimated graph, such as edge sparsity. After unrolling these iterations, prior knowledge over such graph characteristics shape prior distributions over these independently interpretable network parameters to yield a Bayesian neural network (BNN) capable of graph structure learning (GSL) from smooth signal observations. Fast execution and parameter efficiency allow for high-fidelity posterior approximation via Markov Chain Monte Carlo (MCMC) and thus uncertainty quantification on edge predictions. Synthetic and real data experiments corroborate this model's ability to provide well-calibrated estimates of uncertainty, in test cases that include unveiling economic sector modular structure from S$\&$P$500$ data and recovering pairwise digit similarities from MNIST images. Overall, this framework enables GSL in modest-scale applications where uncertainty on the data structure is paramount.

A Sparse Structure Learning Algorithm for Gaussian Bayesian Network Identification from High-Dimensional Data

Learning Gaussian Networks

A survey of Bayesian Network structure learning

A Multi-Granularity Information-Based Method for Learning High-Dimensional Bayesian Network Structures

An Incremental Approach for Sparse Bayesian Network Structure Learning

Learning the Finer Things: Bayesian Structure Learning at the Instantiation Level

Graph Structure Learning with Interpretable Bayesian Neural Networks

Efficient and Scalable Structure Learning for Bayesian Networks: Algorithms and Applications

An efficient Bayesian network structure learning algorithm based on structural information

Bayesian Structure Learning in Multi-layered Genomic Networks

PSL: An Algorithm for Partial Bayesian Network Structure Learning

Testing Sparsity Assumptions in Bayesian Networks

Biological Network Inference With GRASP: A Bayesian Network Structure Learning Method Using Adaptive Sequential Monte Carlo

LSBN: A Large-Scale Bayesian Structure Learning Framework for Model Averaging

An Exploration of Structure Learning in Bayesian Networks

Learning Structures for Deep Neural Networks

Bayesian Structure Learning for Stationary Time Series

Local Structure Discovery in Bayesian Networks

An efficient skeleton learning approach-based hybrid algorithm for identifying Bayesian network structure

Research of Learning Bayesian Networks Structure

Reliable and Efficient Inference of Bayesian Networks from Sparse Data by Statistical Learning Theory