Abstract:Temporal graphs, depicting time-evolving node connections through temporal edges, are extensively utilized in domains where temporal connection patterns are essential, such as recommender systems, financial networks, healthcare, and sensor networks. Despite recent advancements in temporal graph representation learning, performance degradation occurs with periodic collections of new temporal edges, owing to their dynamic nature and newly emerging information. This paper investigates online representation learning on temporal graphs, aiming for efficient updates of temporal models to sustain predictive performance during deployment. Unlike costly retraining or exclusive fine-tuning susceptible to catastrophic forgetting, our approach aims to distill information from previous model parameters and adapt it to newly gathered data. To this end, we propose TGOnline, an adaptive online meta-learning framework, tackling two key challenges. First, to distill valuable knowledge from complex temporal parameters, we establish an optimization objective that determines new parameters, either by leveraging global ones or by placing greater reliance on new data, where global parameters are meta-trained across various data collection periods to enhance temporal generalization. Second, to accelerate the online distillation process, we introduce an edge reduction mechanism that skips new edges lacking additional information and a node deduplication mechanism to prevent redundant computation within training batches on new data. Extensive experiments on four real-world temporal graphs demonstrate the effectiveness and efficiency of TGOnline for online representation learning, outperforming 18 state-of-the-art baselines. Notably, TGOnline not only outperforms the commonly utilized retraining strategy but also achieves a significant speedup of ~30x.

MERIT: Learning Multi-level Representations on Temporal Graphs.

BP-MoE: Behavior Pattern-aware Mixture-of-Experts for Temporal Graph Representation Learning

Continuous-Time Graph Directed Information Maximization for Temporal Network Representation

Self-Supervised Temporal Graph learning with Temporal and Structural Intensity Alignment

Memory-Enhanced Transformer for Representation Learning on Temporal Heterogeneous Graphs

BP-MoE

A Hybrid Continuous-Time Dynamic Graph Representation Learning Model by Exploring Both Temporal and Repetitive Information

A Deep Multi-Task Representation Learning Method for Time Series Classification and Retrieval.

Dynamic Graph Representation Based on Temporal and Contextual Contrasting.

FTM: A Frame-level Timeline Modeling Method for Temporal Graph Representation Learning.

CTRL: Continuous-Time Representation Learning on Temporal Heterogeneous Information Network

Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space

Graph-Level Embedding for Time-Evolving Graphs

Inductive Representation Learning in Temporal Networks via Mining Neighborhood and Community Influences

Temporal Graph Offset Reconstruction: Towards Temporally Robust Graph Representation Learning

Dynamic Graph Representation Based on Temporal and Contextual Contrasting

Learning Representation Of Heterogeneous Temporal Graphs For Recommendation

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

MTT-DynGL: Towards Multidimensional Topology-oriented Time-series Dynamic Graphs Learning Model

TGOnline: Enhancing Temporal Graph Learning with Adaptive Online Meta-Learning

TME-BNA: Temporal Motif-Preserving Network Embedding with Bicomponent Neighbor Aggregation