Abstract:The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create self-supervised signals, neglecting the temporal components carried by real-world graph data, such as timestamps of edges. To overcome this limitation, this paper explores how to model temporal evolution on dynamic graphs elegantly. Specifically, we introduce a new inductive bias, namely temporal translation invariance, which illustrates the tendency of the identical node to keep similar labels across different timespans. Based on this assumption, we develop a dynamic graph representation framework CLDG that encourages the node to maintain locally consistent temporal translation invariance through contrastive learning on different timespans. Except for standard CLDG which only considers explicit topological links, our further proposed CLDG＋＋additionally employs graph diffusion to uncover global contextual correlations between nodes, and designs a multi-scale contrastive learning objective composed of local-local, local-global, and global-global contrasts to enhance representation capabilities. Interestingly, by measuring the consistency between different timespans to shape anomaly indicators, CLDG and CLDG＋＋are seamlessly integrated with the task of spotting anomalies on dynamic graphs, which has broad applications in many high-impact domains, such as finance, cybersecurity, and healthcare. Experiments demonstrate that CLDG and CLDG＋＋both exhibit desirable performance in downstream tasks including node classification and dynamic graph anomaly detection. Moreover, CLDG significantly reduces time and space complexity by implicitly exploiting temporal cues instead of complicated sequence models. The code and data are available at https://github.com/yimingxu24/CLDG.

Time-Varying Graph Learning with Constraints on Graph Temporal Variation

Time-varying Graph Learning Under Structured Temporal Priors

Time-varying graph learning from smooth and stationary graph signals with hidden nodes

STONet: A Neural-Operator-Driven Spatio-temporal Network

Learning Spatiotemporal Graphical Models From Incomplete Observations

Clustering of Time-Varying Graphs Based on Temporal Label Smoothness

Online Graph Learning for Time‐varying Graphs

Robust Time-Varying Graph Signal Recovery for Dynamic Physical Sensor Network Data

Graph signal reconstruction based on spatio-temporal features learning

Learning Time-aware Graph Structures for Spatially Correlated Time Series Forecasting

Sparse Graph Learning from Spatiotemporal Time Series

Bending the Future: Autoregressive Modeling of Temporal Knowledge Graphs in Curvature-Variable Hyperbolic Spaces

Temporal Graph Offset Reconstruction: Towards Temporally Robust Graph Representation Learning

Online Graph Topology Learning from Matrix-valued Time Series

Smoothing of Time-Varying Graph With the Generalized LASSO

Time-Varying Graph Signal Recovery Using High-Order Smoothness and Adaptive Low-rankness

Learning dynamic graph representations through timespan view contrasts

Graph-Level Embedding for Time-Evolving Graphs

Graph-Time Convolutional Neural Networks: Architecture and Theoretical Analysis

On Sparse High-Dimensional Graphical Model Learning For Dependent Time Series

Two Gaussian Regularization Methods for Time-Varying Networks