Abstract:Graph Neural Networks (GNNs) have been widely used for modeling graph-structured data. With the development of numerous GNN variants, recent years have witnessed groundbreaking results in improving the scalability of GNNs to work on static graphs with millions of nodes. However, how to instantly represent continuous changes of large-scale dynamic graphs with GNNs is still an open problem. Existing dynamic GNNs focus on modeling the periodic evolution of graphs, often on a snapshot basis. Such methods suffer from two drawbacks: first, there is a substantial delay for the changes in the graph to be reflected in the graph representations, resulting in losses on the model's accuracy; second, repeatedly calculating the representation matrix on the entire graph in each snapshot is predominantly time-consuming and severely limits the scalability. In this paper, we propose Instant Graph Neural Network (InstantGNN), an incremental computation approach for the graph representation matrix of dynamic graphs. Set to work with dynamic graphs with the edge-arrival model, our method avoids time-consuming, repetitive computations and allows instant updates on the representation and instant predictions. Graphs with dynamic structures and dynamic attributes are both supported. The upper bounds of time complexity of those updates are also provided. Furthermore, our method provides an adaptive training strategy, which guides the model to retrain at moments when it can make the greatest performance gains. We conduct extensive experiments on several real-world and synthetic datasets. Empirical results demonstrate that our model achieves state-of-the-art accuracy while having orders-of-magnitude higher efficiency than existing methods.

A Survey on Dynamic Graph Neural Networks Modeling

A survey of dynamic graph neural networks

Dynamic Graph Representation Learning With Neural Networks: A Survey

A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challenges

Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunities

Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey

A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection

Temporal Graph Networks for Deep Learning on Dynamic Graphs

SiGNN: A Spike-induced Graph Neural Network for Dynamic Graph Representation Learning

Dynamic Neural Networks: A Survey

Deep learning for dynamic graphs: models and benchmarks

Exploring Time Granularity on Temporal Graphs for Dynamic Link Prediction in Real-world Networks

DGNN-MN: Dynamic Graph Neural Network via memory regenerate and neighbor propagation

Graph Neural Networks Designed for Different Graph Types: A Survey

STGSN — A Spatial–Temporal Graph Neural Network framework for time-evolving social networks

Temporal Graph Transformer for Dynamic Network

A Comprehensive Survey on Graph Neural Networks

Dynamic Graph Learning-Neural Network for Multivariate Time Series Modeling

Adaptive Sampling Temporal Graph Network

The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey

Instant Graph Neural Networks for Dynamic Graphs