Abstract:Temporal graphs, depicting time-evolving node connections through temporal edges, are extensively utilized in domains where temporal connection patterns are essential, such as recommender systems, financial networks, healthcare, and sensor networks. Despite recent advancements in temporal graph representation learning, performance degradation occurs with periodic collections of new temporal edges, owing to their dynamic nature and newly emerging information. This paper investigates online representation learning on temporal graphs, aiming for efficient updates of temporal models to sustain predictive performance during deployment. Unlike costly retraining or exclusive fine-tuning susceptible to catastrophic forgetting, our approach aims to distill information from previous model parameters and adapt it to newly gathered data. To this end, we propose TGOnline, an adaptive online meta-learning framework, tackling two key challenges. First, to distill valuable knowledge from complex temporal parameters, we establish an optimization objective that determines new parameters, either by leveraging global ones or by placing greater reliance on new data, where global parameters are meta-trained across various data collection periods to enhance temporal generalization. Second, to accelerate the online distillation process, we introduce an edge reduction mechanism that skips new edges lacking additional information and a node deduplication mechanism to prevent redundant computation within training batches on new data. Extensive experiments on four real-world temporal graphs demonstrate the effectiveness and efficiency of TGOnline for online representation learning, outperforming 18 state-of-the-art baselines. Notably, TGOnline not only outperforms the commonly utilized retraining strategy but also achieves a significant speedup of ~30x.

Temporal Graph ODEs for Irregularly-Sampled Time Series

Temporal Graph Neural Networks for Irregular Data

Learning Continuous System Dynamics from Irregularly-Sampled Partial Observations

Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs

Spatial-Temporal Graph ODE Networks for Traffic Flow Forecasting

Temporal Graph Offset Reconstruction: Towards Temporally Robust Graph Representation Learning

On The Temporal Domain of Differential Equation Inspired Graph Neural Networks

An embedding model for temporal knowledge graphs with long and irregular intervals

Time-Varying Graph Learning with Constraints on Graph Temporal Variation

TimeGraphs: Graph-based Temporal Reasoning

Latent ODEs for Irregularly-Sampled Time Series

Inductive and irregular dynamic network representation based on ordinary differential equations

Graph Neural Flows for Unveiling Systemic Interactions Among Irregularly Sampled Time Series

Continuous Temporal Graph Networks for Event-Based Graph Data

DGSTD: Learning on Dynamic Graph with Spatio-Temporal Disentanglement

Temporal Graph Networks for Deep Learning on Dynamic Graphs

Temporal Graph Analysis with TGX

TGOnline: Enhancing Temporal Graph Learning with Adaptive Online Meta-Learning

Temporal Graph Network for continuous-time dynamic event sequence

Time-aware Graph Structure Learning Via Sequence Prediction on Temporal Graphs.

TANGO: Time-Reversal Latent GraphODE for Multi-Agent Dynamical Systems