Abstract:In the era of big data, managing evolving graph data poses substantial challenges due to storage costs and privacy issues. Training graph neural networks (GNNs) on such evolving data usually causes catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they predominantly operate in centralized architectures and overlook the potential of distributed graph databases to harness collective intelligence for enhanced performance optimization. To address these challenges, we present a pioneering study on Federated Continual Graph Learning (FCGL), which adapts GNNs to multiple evolving graphs within decentralized settings while adhering to storage and privacy constraints. Our work begins with a comprehensive empirical analysis of FCGL, assessing its data characteristics, feasibility, and effectiveness, and reveals two principal challenges: local graph forgetting (LGF), where local GNNs forget prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To tackle these, we propose the POWER framework, which mitigates LGF by preserving and replaying experience nodes with maximum local-global coverage at each client and addresses GEC by using a pseudo prototype reconstruction strategy and trajectory-aware knowledge transfer at the central server. Extensive evaluations across multiple graph datasets demonstrate POWER's superior performance over straightforward federated extensions of the centralized CGL algorithms and vision-focused federated continual learning algorithms. Our code is available at <a class="link-external link-https" href="https://github.com/zyl24/FCGL_POWER" rel="external noopener nofollow">this https URL</a>.

PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensation

E-CGL: An Efficient Continual Graph Learner

Rethinking and Accelerating Graph Condensation: A Training-Free Approach with Class Partition

Simple Graph Condensation

Federated Continual Graph Learning

Incremental Graph Classification by Class Prototype Construction and Augmentation

Graph Condensation for Inductive Node Representation Learning

Continual Graph Learning: A Survey

Reinforced Continual Learning for Graphs

Two Trades is not Baffled: Condensing Graph via Crafting Rational Gradient Matching

Contrastive Graph Condensation: Advancing Data Versatility through Self-Supervised Learning

Graph Condensation for Open-World Graph Learning

Graph Condensation: A Survey

Graph Continual Learning with Debiased Lossless Memory Replay

Graph Data Condensation via Self-expressive Graph Structure Reconstruction

Continual Learning on Graphs: Challenges, Solutions, and Opportunities

Sparsified Subgraph Memory for Continual Graph Representation Learning

Graph Memory Learning: Imitating Lifelong Remembering and Forgetting of Brain Networks

Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Data

Navigating Complexity: Toward Lossless Graph Condensation via Expanding Window Matching

Streaming Graph Neural Networks Via Continual Learning