Abstract:Graph Neural Networks (GNNs) traditionally employ a message-passing mechanism that resembles diffusion over undirected graphs, which often leads to homogenization of node features and reduced discriminative power in tasks such as node classification. Our key insight for addressing this limitation is to assign fuzzy edge directions -- that can vary continuously from node $i$ pointing to node $j$ to vice versa -- to the edges of a graph so that features can preferentially flow in one direction between nodes to enable long-range information transmission across the graph. We also introduce a novel complex-valued Laplacian for directed graphs with fuzzy edges where the real and imaginary parts represent information flow in opposite directions. Using this Laplacian, we propose a general framework, called Continuous Edge Direction (CoED) GNN, for learning on graphs with fuzzy edges and prove its expressivity limits using a generalization of the Weisfeiler-Leman (WL) graph isomorphism test for directed graphs with fuzzy edges. Our architecture aggregates neighbor features scaled by the learned edge directions and processes the aggregated messages from in-neighbors and out-neighbors separately alongside the self-features of the nodes. Since continuous edge directions are differentiable, they can be learned jointly with the GNN weights via gradient-based optimization. CoED GNN is particularly well-suited for graph ensemble data where the graph structure remains fixed but multiple realizations of node features are available, such as in gene regulatory networks, web connectivity graphs, and power grids. We demonstrate through extensive experiments on both synthetic and real datasets that learning continuous edge directions significantly improves performance both for undirected and directed graphs compared with existing methods.

Continuous Spiking Graph Neural Networks

Spiking Graph Convolutional Networks

Dynamic Spiking Framework for Graph Neural Networks

Neural Dynamics on Complex Networks

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Dynamic Spiking Graph Neural Networks.

Spiking Deep Residual Networks.

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

SiGNN: A Spike-induced Graph Neural Network for Dynamic Graph Representation Learning

Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

Newton-Cotes Graph Neural Networks: on the Time Evolution of Dynamic Systems

From Continuous Dynamics to Graph Neural Networks: Neural Diffusion and Beyond

Accurate and Scalable Graph Neural Networks for Billion-Scale Graphs

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Continuous Temporal Graph Networks for Event-Based Graph Data

Reinforced Continual Learning for Graphs

Instant Graph Neural Networks for Dynamic Graphs

Spatiotemporal Learning on Cell-embedded Graphs

Improving Graph Neural Networks by Learning Continuous Edge Directions

Unveiling the Potential of Spiking Dynamics in Graph Representation Learning through Spatial-Temporal Normalization and Coding Strategies

Higher-Order GNNs Meet Efficiency: Sparse Sobolev Graph Neural Networks