Abstract:Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse problem with a smoothness promoting objective and rely on iterative methods to obtain a solution. In supervised settings where graph labels are available, one can unroll and truncate these iterations into a deep network that is trained end-to-end. Such a network is parameter efficient and inherits inductive bias from the optimization formulation, an appealing aspect for data constrained settings in, e.g., medicine, finance, and the natural sciences. But typically such settings care equally about uncertainty over edge predictions, not just point estimates. Here we introduce novel iterations with independently interpretable parameters, i.e., parameters whose values - independent of other parameters' settings - proportionally influence characteristics of the estimated graph, such as edge sparsity. After unrolling these iterations, prior knowledge over such graph characteristics shape prior distributions over these independently interpretable network parameters to yield a Bayesian neural network (BNN) capable of graph structure learning (GSL) from smooth signal observations. Fast execution and parameter efficiency allow for high-fidelity posterior approximation via Markov Chain Monte Carlo (MCMC) and thus uncertainty quantification on edge predictions. Synthetic and real data experiments corroborate this model's ability to provide well-calibrated estimates of uncertainty, in test cases that include unveiling economic sector modular structure from S$\&$P$500$ data and recovering pairwise digit similarities from MNIST images. Overall, this framework enables GSL in modest-scale applications where uncertainty on the data structure is paramount.

Interpreting Basis Path Set in Neural Networks

Constructing Basis Path Set by Eliminating Path Dependency

GeniePath: Graph Neural Networks with Adaptive Receptive Paths

Capacity Control of ReLU Neural Networks by Basis-path Norm

Approach for training of Gaussian basis function classifier

Hierarchical Gate Network for Fine-Grained Visual Recognition.

BAB-GSL: Using Bayesian influence with attention mechanism to optimize graph structure in basic views

Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition

On Privileged and Convergent Bases in Neural Network Representations

G-SGD: Optimizing ReLU Neural Networks in Its Positively Scale-Invariant Space.

Path-BN - Towards effective batch normalization in the Path Space for ReLU networks.

Graph Structure Learning with Interpretable Bayesian Neural Networks

Basis Operator Network: A Neural Network-Based Model for Learning Nonlinear Operators Via Neural Basis

How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashing

Unsupervised Interpretable Basis Extraction for Concept-Based Visual Explanations

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

Towards Graph Foundation Models: A Study on the Generalization of Positional and Structural Encodings

Understanding Short-Range Memory Effects in Deep Neural Networks

An optimizing BP neural network algorithm based on genetic algorithm

GCN for HIN via Implicit Utilization of Attention and Meta-paths

Graph-Based Similarity of Neural Network Representations.