Abstract:In the era of big data, managing evolving graph data poses substantial challenges due to storage costs and privacy issues. Training graph neural networks (GNNs) on such evolving data usually causes catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they predominantly operate in centralized architectures and overlook the potential of distributed graph databases to harness collective intelligence for enhanced performance optimization. To address these challenges, we present a pioneering study on Federated Continual Graph Learning (FCGL), which adapts GNNs to multiple evolving graphs within decentralized settings while adhering to storage and privacy constraints. Our work begins with a comprehensive empirical analysis of FCGL, assessing its data characteristics, feasibility, and effectiveness, and reveals two principal challenges: local graph forgetting (LGF), where local GNNs forget prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To tackle these, we propose the POWER framework, which mitigates LGF by preserving and replaying experience nodes with maximum local-global coverage at each client and addresses GEC by using a pseudo prototype reconstruction strategy and trajectory-aware knowledge transfer at the central server. Extensive evaluations across multiple graph datasets demonstrate POWER's superior performance over straightforward federated extensions of the centralized CGL algorithms and vision-focused federated continual learning algorithms. Our code is available at <a class="link-external link-https" href="https://github.com/zyl24/FCGL_POWER" rel="external noopener nofollow">this https URL</a>.

A New Paradigm for Federated Structure Non-IID Subgraph Learning

AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneity

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

Optimizing Federated Graph Learning with Inherent Structural Knowledge and Dual-Densely Connected GNNs

Federated Graph Learning with Graphless Clients

Tackling the Local Bias in Federated Graph Learning

Federated Graph Learning -- A Position Paper

Structural graph federated learning: Exploiting high-dimensional information of statistical heterogeneity

FedGL: Federated graph learning framework with global self-supervision

FedGTA: Topology-aware Averaging for Federated Graph Learning

An Information Theoretic Perspective for Heterogeneous Subgraph Federated Learning

Federated Continual Graph Learning

FedHGN: A Federated Framework for Heterogeneous Graph Neural Networks

Federated Hypergraph Learning: Hyperedge Completion with Local Differential Privacy

Federated Graph Semantic and Structural Learning

Equipping Federated Graph Neural Networks with Structure-aware Group Fairness

Federated Graph Learning with Structure Proxy Alignment

SpreadFGL: Edge-Client Collaborative Federated Graph Learning with Adaptive Neighbor Generation

HiFGL: A Hierarchical Framework for Cross-silo Cross-device Federated Graph Learning

FGAD: Self-boosted Knowledge Distillation for An Effective Federated Graph Anomaly Detection Framework

ASFGNN: Automated Separated-Federated Graph Neural Network