Abstract:In the era of big data, managing evolving graph data poses substantial challenges due to storage costs and privacy issues. Training graph neural networks (GNNs) on such evolving data usually causes catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they predominantly operate in centralized architectures and overlook the potential of distributed graph databases to harness collective intelligence for enhanced performance optimization. To address these challenges, we present a pioneering study on Federated Continual Graph Learning (FCGL), which adapts GNNs to multiple evolving graphs within decentralized settings while adhering to storage and privacy constraints. Our work begins with a comprehensive empirical analysis of FCGL, assessing its data characteristics, feasibility, and effectiveness, and reveals two principal challenges: local graph forgetting (LGF), where local GNNs forget prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To tackle these, we propose the POWER framework, which mitigates LGF by preserving and replaying experience nodes with maximum local-global coverage at each client and addresses GEC by using a pseudo prototype reconstruction strategy and trajectory-aware knowledge transfer at the central server. Extensive evaluations across multiple graph datasets demonstrate POWER's superior performance over straightforward federated extensions of the centralized CGL algorithms and vision-focused federated continual learning algorithms. Our code is available at <a class="link-external link-https" href="https://github.com/zyl24/FCGL_POWER" rel="external noopener nofollow">this https URL</a>.

Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristics

Federated Graph Learning with Graphless Clients

Optimizing Federated Graph Learning with Inherent Structural Knowledge and Dual-Densely Connected GNNs

Towards Communication-Efficient Federated Graph Learning: an Adaptive Client Selection Perspective

AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneity

FedDGP: Disentangling Global and Personal Models for Federated Learning

A New Paradigm for Federated Structure Non-IID Subgraph Learning

Structural graph federated learning: Exploiting high-dimensional information of statistical heterogeneity

SpreadFGL: Edge-Client Collaborative Federated Graph Learning with Adaptive Neighbor Generation

Tackling the Local Bias in Federated Graph Learning

Federated Graph Learning with Structure Proxy Alignment

Federated Graph Augmentation for Semisupervised Node Classification

FedGTA: Topology-aware Averaging for Federated Graph Learning

FedGL: Federated graph learning framework with global self-supervision

Federated Continual Graph Learning

Federated Graph Semantic and Structural Learning

FedAGA: A federated learning framework for enhanced inter-client relationship learning

Federated Hypergraph Learning: Hyperedge Completion with Local Differential Privacy

FedHGN: A Federated Framework for Heterogeneous Graph Neural Networks

FedSheafHN: Personalized Federated Learning on Graph-structured Data

Prompting Label Efficiency in Federated Graph Learning Via Personalized Semi-Supervision