Abstract:In the era of big data, managing evolving graph data poses substantial challenges due to storage costs and privacy issues. Training graph neural networks (GNNs) on such evolving data usually causes catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they predominantly operate in centralized architectures and overlook the potential of distributed graph databases to harness collective intelligence for enhanced performance optimization. To address these challenges, we present a pioneering study on Federated Continual Graph Learning (FCGL), which adapts GNNs to multiple evolving graphs within decentralized settings while adhering to storage and privacy constraints. Our work begins with a comprehensive empirical analysis of FCGL, assessing its data characteristics, feasibility, and effectiveness, and reveals two principal challenges: local graph forgetting (LGF), where local GNNs forget prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To tackle these, we propose the POWER framework, which mitigates LGF by preserving and replaying experience nodes with maximum local-global coverage at each client and addresses GEC by using a pseudo prototype reconstruction strategy and trajectory-aware knowledge transfer at the central server. Extensive evaluations across multiple graph datasets demonstrate POWER's superior performance over straightforward federated extensions of the centralized CGL algorithms and vision-focused federated continual learning algorithms. Our code is available at <a class="link-external link-https" href="https://github.com/zyl24/FCGL_POWER" rel="external noopener nofollow">this https URL</a>.

Federated Continuous Learning With Broad Network Architecture

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Asynchronous Federated Learning over Wireless Communication Networks.

Federated Continual Learning via Knowledge Fusion: A Survey

A Generalized Look at Federated Learning: Survey and Perspectives

Accurate Forgetting for Heterogeneous Federated Continual Learning

Variational Bayes for Federated Continual Learning

Federated Learning in Practice: Reflections and Projections

Continual Federated Learning Based on Knowledge Distillation

CONTINUAL LOCAL TRAINING FOR BETTER INITIALIZATION OF FEDERATED MODELS

Federated Continual Graph Learning

Confederated Learning: Federated Learning with Decentralized Edge Servers

Towards Client Driven Federated Learning

Advances and Open Problems in Federated Learning

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Bilateral Improvement in Local Personalization and Global Generalization in Federated Learning.

"Federated Learning: Advancements, Applications, and Future Directions for Collaborative Machine Learning in Distributed Environments"

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Federated learning: Applications, challenges and future directions