Abstract:Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse problem with a smoothness promoting objective and rely on iterative methods to obtain a solution. In supervised settings where graph labels are available, one can unroll and truncate these iterations into a deep network that is trained end-to-end. Such a network is parameter efficient and inherits inductive bias from the optimization formulation, an appealing aspect for data constrained settings in, e.g., medicine, finance, and the natural sciences. But typically such settings care equally about uncertainty over edge predictions, not just point estimates. Here we introduce novel iterations with independently interpretable parameters, i.e., parameters whose values - independent of other parameters' settings - proportionally influence characteristics of the estimated graph, such as edge sparsity. After unrolling these iterations, prior knowledge over such graph characteristics shape prior distributions over these independently interpretable network parameters to yield a Bayesian neural network (BNN) capable of graph structure learning (GSL) from smooth signal observations. Fast execution and parameter efficiency allow for high-fidelity posterior approximation via Markov Chain Monte Carlo (MCMC) and thus uncertainty quantification on edge predictions. Synthetic and real data experiments corroborate this model's ability to provide well-calibrated estimates of uncertainty, in test cases that include unveiling economic sector modular structure from S$\&$P$500$ data and recovering pairwise digit similarities from MNIST images. Overall, this framework enables GSL in modest-scale applications where uncertainty on the data structure is paramount.

Learning Latent Graph Structures and their Uncertainty

Uncertainty Modeling in Graph Neural Networks via Stochastic Differential Equations

Graph Stochastic Neural Networks for Semi-supervised Learning.

Node Regression on Latent Position Random Graphs via Local Averaging

Sparse Graph Learning from Spatiotemporal Time Series

Graph Structure Learning with Interpretable Bayesian Neural Networks

Non-Parametric Graph Learning for Bayesian Graph Neural Networks

Semi-Supervised Graph Neural Network with Probabilistic Modeling to Mitigate Uncertainty

A Study of Joint Graph Inference and Forecasting

Learning Graph Structure from Convolutional Mixtures

Uncertainty Aware Semi-Supervised Learning on Graph Data

Learning Neural Point Processes with Latent Graphs

How Graph Neural Networks Learn: Lessons from Training Dynamics in Function Space

Graph Learning from Data under Structural and Laplacian Constraints

Probability Passing for Graph Neural Networks: Graph Structure and Representations Joint Learning

Graph Relearn Network: Reducing Performance Variance and Improving Prediction Accuracy of Graph Neural Networks

Neural Trees for Learning on Graphs

Deep Graph Neural Networks via Flexible Subgraph Aggregation

Semisupervised regression in latent structure networks on unknown manifolds

Learning Graph Neural Networks with Positive and Unlabeled Nodes

How Graph Neural Networks Learn: Lessons from Training Dynamics