Abstract:In the era of big data, managing evolving graph data poses substantial challenges due to storage costs and privacy issues. Training graph neural networks (GNNs) on such evolving data usually causes catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they predominantly operate in centralized architectures and overlook the potential of distributed graph databases to harness collective intelligence for enhanced performance optimization. To address these challenges, we present a pioneering study on Federated Continual Graph Learning (FCGL), which adapts GNNs to multiple evolving graphs within decentralized settings while adhering to storage and privacy constraints. Our work begins with a comprehensive empirical analysis of FCGL, assessing its data characteristics, feasibility, and effectiveness, and reveals two principal challenges: local graph forgetting (LGF), where local GNNs forget prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To tackle these, we propose the POWER framework, which mitigates LGF by preserving and replaying experience nodes with maximum local-global coverage at each client and addresses GEC by using a pseudo prototype reconstruction strategy and trajectory-aware knowledge transfer at the central server. Extensive evaluations across multiple graph datasets demonstrate POWER's superior performance over straightforward federated extensions of the centralized CGL algorithms and vision-focused federated continual learning algorithms. Our code is available at <a class="link-external link-https" href="https://github.com/zyl24/FCGL_POWER" rel="external noopener nofollow">this https URL</a>.

Federated Multi-task Graph Learning

HFedMTL: Hierarchical Federated Multi-Task Learning

FedGTA: Topology-aware Averaging for Federated Graph Learning

Federated Graph Learning -- A Position Paper

FedDGA: Federated Multi-Task Learning Based on Dynamic Guided Attention

Optimizing Federated Graph Learning with Inherent Structural Knowledge and Dual-Densely Connected GNNs

Multitask Learning Over Graphs: An Approach for Distributed, Streaming Machine Learning

Federated Hypergraph Learning: Hyperedge Completion with Local Differential Privacy

FedGL: Federated graph learning framework with global self-supervision

Tackling the Local Bias in Federated Graph Learning

SpreadGNN: Decentralized Multi-Task Federated Learning for Graph Neural Networks on Molecular Data

Federated Continual Graph Learning

A New Paradigm for Federated Structure Non-IID Subgraph Learning

Graph Federated Learning Based on the Decentralized Framework

Heterogeneous Federated Learning on a Graph

A New Look and Convergence Rate of Federated Multi-Task Learning with Laplacian Regularization

AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneity

A New Look and Convergence Rate of Federated Multitask Learning With Laplacian Regularization

Graph Federated Learning with Hidden Representation Sharing

Federated Graph Machine Learning

FedGT: Federated Node Classification with Scalable Graph Transformer