Abstract:Graph Neural Networks (GNNs) have been widely used for modeling graph-structured data. With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static graphs with millions of nodes. However, how to instantly represent continuous changes of large-scale dynamic graphs with GNNs is still an open problem. Existing dynamic GNNs focus on modeling the periodic evolution of graphs, often on a snapshot basis. Such methods suffer from two drawbacks: first, there is a substantial delay for the changes in the graph to be reflected in the graph representations, resulting in losses on the model's accuracy; second, repeatedly calculating the representation matrix on the entire graph in each snapshot is predominantly time-consuming and severely limits the scalability. In this paper, we propose Instant Graph Neural Network (InstantGNN), an incremental computation approach for the graph representation matrix of dynamic graphs. Set to work with dynamic graphs with the edge-arrival model, our method avoids time-consuming, repetitive computations and allows instant updates on the representation and instant predictions. Graphs with dynamic structures and dynamic attributes are both supported. The upper bounds of time complexity of those updates are also provided. Furthermore, our method provides an adaptive training strategy, which guides the model to retrain at moments when it can make the greatest performance gains. We conduct extensive experiments on several real-world and synthetic datasets. Empirical results demonstrate that our model achieves state-of-the-art accuracy while having orders-of-magnitude higher efficiency than existing methods.

Dynamic Spiking Framework for Graph Neural Networks

Dynamic Spiking Graph Neural Networks.

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Scaling Up Dynamic Graph Representation Learning Via Spiking Neural Networks

Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

Spiking Graph Convolutional Networks

Instant Graph Neural Networks for Dynamic Graphs

Unveiling the Potential of Spiking Dynamics in Graph Representation Learning through Spatial-Temporal Normalization and Coding Strategies

SiGNN: A Spike-induced Graph Neural Network for Dynamic Graph Representation Learning

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Spiking Deep Residual Networks.

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

DGNN-MN: Dynamic Graph Neural Network via memory regenerate and neighbor propagation

DynaGraph: dynamic graph neural networks at scale

Efficient and Effective Implicit Dynamic Graph Neural Network

Continuous Spiking Graph Neural Networks

Learning Improvement of Spiking Neural Networks with Dynamic Adaptive Hyperparameter Neurons

Dynamic Spatio-Temporal Graph Network with Adaptive Propagation Mechanism for Multivariate Time Series Forecasting

Dynamic Personalized Graph Neural Network with Linear Complexity for Multivariate Time Series Forecasting

SDG: A Simplified and Dynamic Graph Neural Network