Abstract:Graph Neural Networks (GNNs) have emerged as a prominent research topic in the field of machine learning. Existing GNN models are commonly categorized into two types: spectral GNNs, which are designed based on polynomial graph filters, and spatial GNNs, which utilize a message-passing scheme as the foundation of the model. For the expressive power and universality of spectral GNNs, a natural approach is to improve the design of basis functions for better approximation ability. As for spatial GNNs, models like Graph Isomorphism Networks (GIN) analyze their expressive power based on Graph Isomorphism Tests. Recently, there have been attempts to establish connections between spatial GNNs and geometric concepts like curvature and cellular sheaves, as well as physical phenomena like oscillators. However, despite the recent progress, there is still a lack of comprehensive analysis regarding the universality of spatial GNNs from the perspectives of geometry and physics. In this paper, we propose MetricGNN (MGNN), a spatial GNN model inspired by the congruent-insensitivity property of classifiers in the classification phase of GNNs. We demonstrate that a GNN model is universal in the spatial domain if it can generate embedding matrices that are congruent to any given embedding matrix. This property is closely related to the Distance Geometry Problem (DGP). Since DGP is an NP-Hard combinatorial optimization problem, we propose optimizing an energy function derived from spring networks and the Multi-Dimensional Scaling (MDS) problem. This approach also allows our model to handle both homophilic and heterophilic graphs. Finally, we propose employing the iteration method to optimize our energy function. We extensively evaluate the effectiveness of our model through experiments conducted on both synthetic and real-world datasets. Our code is available at: <a class="link-external link-https" href="https://github.com/GuanyuCui/MGNN" rel="external noopener nofollow">this https URL</a>.

Unifying Spectral and Spatial Graph Neural Networks

A Survey on Spectral Graph Neural Networks

Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective

Graph Neural Networks with Diverse Spectral Filtering

Benchmarking Spectral Graph Neural Networks: A Comprehensive Study on Effectiveness and Efficiency

How Powerful are Spectral Graph Neural Networks.

Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering

Spectral GNN via Two-dimensional (2-D) Graph Convolution

Revisiting graph neural networks from hybrid regularized graph signal reconstruction

A Unified Framework for Convolution-Based Graph Neural Networks

Understanding Graph Neural Networks from Graph Signal Denoising Perspectives

On the Expressive Power of Spectral Invariant Graph Neural Networks

Addressing Heterogeneity and Heterophily in Graphs: A Heterogeneous Heterophilic Spectral Graph Neural Network

Node-oriented Spectral Filtering for Graph Neural Networks

Survey of Graph Neural Networks and Applications

MGNN: Graph Neural Networks Inspired by Distance Geometry Problem

Graph Neural Networks: Foundation, Frontiers and Applications

Feature Expansion for Graph Neural Networks

A Unified View on Graph Neural Networks as Graph Signal Denoising

Understanding Spectral Graph Neural Network