Abstract:The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create self-supervised signals, neglecting the temporal components carried by real-world graph data, such as timestamps of edges. To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical node to keep similar labels across different timespans. Based on this assumption, we develop a dynamic graph representation framework CLDG that encourages the node to maintain locally consistent temporal translation invariance through contrastive learning on different timespans. Except for standard CLDG which only considers explicit topological links, our further proposed CLDG＋＋additionally employs graph diffusion to uncover global contextual correlations between nodes, and designs a multi-scale contrastive learning objective composed of local-local, local-global, and global-global contrasts to enhance representation capabilities. Interestingly, by measuring the consistency between different timespans to shape anomaly indicators, CLDG and CLDG＋＋are seamlessly integrated with the task of spotting anomalies on dynamic graphs, which has broad applications in many high-impact domains, such as finance, cybersecurity, and healthcare. Experiments demonstrate that CLDG and CLDG＋＋both exhibit desirable performance in downstream tasks including node classification and dynamic graph anomaly detection. Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models. The code and data are available at https://github.com/yimingxu24/CLDG.

An Empirical Evaluation of Temporal Graph Benchmark

Temporal Graph Benchmark for Machine Learning on Temporal Graphs

TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphs

DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs

Temporal receptive field in dynamic graph learning: A comprehensive analysis

Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hours

Towards Better Dynamic Graph Learning: New Architecture and Unified Library

A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challenges

Analysis of different temporal graph neural network configurations on dynamic graphs

Scalable and Efficient Temporal Graph Representation Learning via Forward Recent Sampling

Temporal Graph Analysis with TGX

Introduction to a Temporal Graph Benchmark

Temporal-Aware Evaluation and Learning for Temporal Graph Neural Networks

SIMPLE: Efficient Temporal Graph Neural Network Training at Scale with Dynamic Data Placement.

Datasets for Paper "benchtemp: A General Benchmark for Evaluating Temporal Graph Neural Networks"

TGOnline: Enhancing Temporal Graph Learning with Adaptive Online Meta-Learning

Temporal Graph Generation Featuring Time-Bound Communities

Learning dynamic graph representations through timespan view contrasts

TIGER: Temporally Improved Graph Entity Linker

New Perspectives on the Evaluation of Link Prediction Algorithms for Dynamic Graphs

DyG2Vec: Efficient Representation Learning for Dynamic Graphs