Abstract:Graph Neural networks (GNNs) which are powerful and widely applied models are based on the assumption that graph topologies play key roles in the graph representation learning.However, the existing GNN methods are based on the Euclidean space embedding, which is difficult to represent a variety of graph geometric properties well. Recently, Riemannian geometries have been introduced into GNNs, such as Hyperbolic Graph Neural Networks proposed for the hierarchy-preserving graph representation learning. In Riemannian geometry, the different graph topological structures can be reflected by corresponding curved embedding spaces, such as a hyperbolic space can be understood as a continuous tree-like structure and a spherical space can be understood as a continuous clique. However, most existing non-Euclidean GNNs are based on heuristic, manual statistical, or estimation methods, which is difficult to automatically select the appropriate embedding space for graphs with different topological properties. To deal with this problem, we propose the Adaptive Curvature Exploration Geometric Graph Neural Network to automatically learn high-quality graph representations and explore the embedding space with optimal curvature at the same time. We optimize the multi-objective optimization problem of the graph representation learning and curvature exploration with the multi-agent reinforcement learning and using the Nash Q-learning algorithm to collaboratively train the two agents to reach Nash equilibrium. We construct extensive experiments including synthetic and real-world graph datasets, and the results demonstrate significant and consistent performance improvement and generalization of our method.

Curvature constrained MPNNs : Improving message passing with local structural properties

Understanding over-squashing and bottlenecks on graphs via curvature

The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited

Preventing Representational Rank Collapse in MPNNs by Splitting the Computational Graph

On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology

Hyperbolic Curvature Graph Neural Network

How Curvature Enhance the Adaptation Power of Framelet GCNs

A Theoretical Formulation of Many-body Message Passing Neural Networks

Probabilistically Rewired Message-Passing Neural Networks

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Analyzing Neural Network Robustness Using Graph Curvature

Towards Dynamic Message Passing on Graphs

Neural Message Passing Induced by Energy-Constrained Diffusion

Next Level Message-Passing with Hierarchical Support Graphs

Adaptive curvature exploration geometric graph neural network

Generalization Bounds for Message Passing Networks on Mixture of Graphons

Revisiting Over-smoothing and Over-squashing using Ollivier's Ricci Curvature

Graph Coarsening with Message-Passing Guarantees

Framelet Message Passing

Graph Unitary Message Passing

Verifying message-passing neural networks via topology-based bounds tightening