Abstract:Graph Neural Networks (GNNs) have emerged as a prominent research topic in the field of machine learning. Existing GNN models are commonly categorized into two types: spectral GNNs, which are designed based on polynomial graph filters, and spatial GNNs, which utilize a message-passing scheme as the foundation of the model. For the expressive power and universality of spectral GNNs, a natural approach is to improve the design of basis functions for better approximation ability. As for spatial GNNs, models like Graph Isomorphism Networks (GIN) analyze their expressive power based on Graph Isomorphism Tests. Recently, there have been attempts to establish connections between spatial GNNs and geometric concepts like curvature and cellular sheaves, as well as physical phenomena like oscillators. However, despite the recent progress, there is still a lack of comprehensive analysis regarding the universality of spatial GNNs from the perspectives of geometry and physics. In this paper, we propose MetricGNN (MGNN), a spatial GNN model inspired by the congruent-insensitivity property of classifiers in the classification phase of GNNs. We demonstrate that a GNN model is universal in the spatial domain if it can generate embedding matrices that are congruent to any given embedding matrix. This property is closely related to the Distance Geometry Problem (DGP). Since DGP is an NP-Hard combinatorial optimization problem, we propose optimizing an energy function derived from spring networks and the Multi-Dimensional Scaling (MDS) problem. This approach also allows our model to handle both homophilic and heterophilic graphs. Finally, we propose employing the iteration method to optimize our energy function. We extensively evaluate the effectiveness of our model through experiments conducted on both synthetic and real-world datasets. Our code is available at: <a class="link-external link-https" href="https://github.com/GuanyuCui/MGNN" rel="external noopener nofollow">this https URL</a>.

Learning Graphons via Structured Gromov-Wasserstein Barycenters

Graph Learning in Low Dimensional Space for Graph Convolutional Networks

Graph data augmentation with Gromow-Wasserstein Barycenters

Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenters

Outlier-Robust Gromov-Wasserstein for Graph Data

Learning Sparse Graphons and the Generalized Kesten-Stigum Threshold

Partial Gromov-Wasserstein Learning for Partial Graph Matching

Learning graph-level representation from local-structural distribution with Graph Neural Networks

Learning Graph Structure from Convolutional Mixtures

Learning the Geodesic Embedding with Graph Neural Networks

Exploiting Edge Features in Graphs with Fused Network Gromov-Wasserstein Distance

Graph Geometry Interaction Learning

Graph Structure Learning with Interpretable Bayesian Neural Networks

Graphon Particle Systems, Part I: Spatio-Temporal Approximation and Law of Large Numbers

Graph Metric Learning Via Gershgorin Disc Alignment

DAG-GNN: DAG Structure Learning with Graph Neural Networks

How to compute the barycenter of a weighted graph

Graph Learning from Gaussian and Stationary Graph Signals

On A Linear Fused Gromov-Wasserstein Distance For Graph Structured Data

GraphGAN: Graph Representation Learning with Generative Adversarial Nets

MGNN: Graph Neural Networks Inspired by Distance Geometry Problem