Abstract:Temporal graph neural networks (T-GNNs) have emerged as leading approaches for representation learning over dynamic graphs. However, existing solutions typically suffer from exponential time complexity with model depth and excessive GPU memory usage due to acceleration techniques, and cannot handle large dynamic graphs. Furthermore, the core component of T-G NNs, temporal message passing, still predominantly derives from static GNNs. This neglects the distinct characteristics of two types of features, timestamps and edge features, and results in sub-optimal embedding quality. Consequently, existing T-GNNs fail to scale to large dynamic graphs and generalize well in unseen or complex scenarios, limiting their applicability. To bridge the gap, this paper first proposes a simple yet effective temporal message passing paradigm for T-GNNs, called the divided temporal message passing (DT-MP) paradigm, which enables effective feature learning for each feature type. We theoretically demonstrate that the DT-MP paradigm can reduce GPU memory usage compared to existing T-GNNs. Building on this foundation, we propose TimeSGN, a scalable and effective temporal graph neural network, which can handle billion-scale dynamic graphs. Specifically, we design a linear state updater to effectively capture node dynamic evolution and instantiate the DT-MP paradigm using two 1-layer self-attention mechanisms for temporal message passing to generate temporal embeddings. As a result, TimeSGN fundamentally avoids exponential time complexity and significantly reduces GPU memory usage. Extensive experiments demonstrate that TimeSGN achieves an average 10.56% improvement in accuracy, up to 42.48% reduction in training GPU memory, and up to 5 x speedup in per-epoch training time compared to the state-of-the-art baselines, while being one order of magnitude faster than vanilla T-GNNs.

STGSN — A Spatial–Temporal Graph Neural Network framework for time-evolving social networks

Dynamic Spatiotemporal Graph Neural Network with Tensor Network

STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model

A Spatial-Temporal Graph Mining Algorithm Based on Spatial-Temporal Sparse Attention

TimeSGN: Scalable and Effective Temporal Graph Neural Network

Semantics-Enhanced Temporal Graph Networks for Content Caching and Energy Saving.

Advances in spatiotemporal graph neural network prediction research

Temporal Graph Networks for Deep Learning on Dynamic Graphs

Temporal Graph Transformer for Dynamic Network

Spatial-Temporal Graph Deviation Neural Networks for Anomaly Detection in Time Series

STGIN: A Spatial Temporal Graph-Informer Network for Long Sequence Traffic Speed Forecasting

Spatial-Temporal Synchronous Graph Convolutional Networks: A New Framework for Spatial-Temporal Network Data Forecasting

A Survey on Dynamic Graph Neural Networks Modeling

Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey

Dynamic Spatio-Temporal Graph Network with Adaptive Propagation Mechanism for Multivariate Time Series Forecasting

SiGNN: A Spike-induced Graph Neural Network for Dynamic Graph Representation Learning

Spatial-Temporal Attention Network for Crime Prediction with Adaptive Graph Learning

Analysis of different temporal graph neural network configurations on dynamic graphs

Adaptive Spatio-temporal Graph Neural Network for traffic forecasting

Who Should I Engage with At What Time? A Missing Event Aware Temporal Graph Neural Network

Learning Time-aware Graph Structures for Spatially Correlated Time Series Forecasting