Abstract:The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create self-supervised signals, neglecting the temporal components carried by real-world graph data, such as timestamps of edges. To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical node to keep similar labels across different timespans. Based on this assumption, we develop a dynamic graph representation framework CLDG that encourages the node to maintain locally consistent temporal translation invariance through contrastive learning on different timespans. Except for standard CLDG which only considers explicit topological links, our further proposed CLDG＋＋additionally employs graph diffusion to uncover global contextual correlations between nodes, and designs a multi-scale contrastive learning objective composed of local-local, local-global, and global-global contrasts to enhance representation capabilities. Interestingly, by measuring the consistency between different timespans to shape anomaly indicators, CLDG and CLDG＋＋are seamlessly integrated with the task of spotting anomalies on dynamic graphs, which has broad applications in many high-impact domains, such as finance, cybersecurity, and healthcare. Experiments demonstrate that CLDG and CLDG＋＋both exhibit desirable performance in downstream tasks including node classification and dynamic graph anomaly detection. Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models. The code and data are available at https://github.com/yimingxu24/CLDG.

MTT-DynGL: Towards Multidimensional Topology-oriented Time-series Dynamic Graphs Learning Model

Dynamic Graph Representation Based on Temporal and Contextual Contrasting.

Dynamic Graph Structure Learning for Multivariate Time Series Forecasting

Continuous-Time Dynamic Graph Learning Via Neural Interaction Processes.

Dynamic Graph Representation Based on Temporal and Contextual Contrasting

Temporal Graph Transformer for Dynamic Network

Multi-relational Dynamic Graph Representation Learning

DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models

TCL: Transformer-based Dynamic Graph Modelling Via Contrastive Learning

DGSTD: Learning on Dynamic Graph with Spatio-Temporal Disentanglement

TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

DTFormer: A Transformer-Based Method for Discrete-Time Dynamic Graph Representation Learning

DS-TAGCN: A Dual-Stream Topology Attentive GCN for Node Classification in Dynamic Graphs.

TemporalGAT: Attention-Based Dynamic Graph Representation Learning

Dynamic Graph Learning-Neural Network for Multivariate Time Series Modeling

Learning dynamic graph representations through timespan view contrasts

EasyDGL: Encode, Train and Interpret for Continuous-time Dynamic Graph Learning

A Hybrid Continuous-Time Dynamic Graph Representation Learning Model by Exploring Both Temporal and Repetitive Information

Dynamic Graph Representation Learning via Edge Temporal States Modeling and Structure-reinforced Transformer

Learning Dynamic Temporal Relations with Continuous Graph for Multivariate Time Series Forecasting (student Abstract).

Multi-Scale Dynamic Graph Learning for Time Series Anomaly Detection (student Abstract)