Abstract:Federated learning (FL) is a machine-learning setting, where multiple clients collaboratively train a model under the coordination of a central server. The clients' raw data are locally stored, and each client only uploads the trained weight to the server, which can mitigate the privacy risks from the centralized machine learning. However, most of the existing FL models focus on one-time learning without consideration for continuous learning. Continuous learning supports learning from streaming data continuously, so it can adapt to environmental changes and provide better real-time performance. In this article, we present a federated continuous learning scheme based on broad learning (FCL-BL) to support efficient and accurate federated continuous learning (FCL). In FCL-BL, we propose a weighted processing strategy to solve the catastrophic forgetting problem, so FCL-BL can handle continuous learning. Then, we develop a local-independent training solution to support fast and accurate training in FCL-BL. The proposed solution enables us to avoid using a time-consuming synchronous approach while addressing the inaccurate-training issue rooted in the previous asynchronous approach. Moreover, we introduce a batch-asynchronous approach and broad learning (BL) technique to guarantee the high efficiency of FCL-BL. Specifically, the batch-asynchronous approach reduces the number of client-server interaction rounds, and the BL technique supports incremental learning without retraining when learning newly produced data. Finally, theoretical analysis and experimental results further illustrate that FCL-BL is superior to the existing FL schemes in terms of efficiency and accuracy in FCL.

Accurate Forgetting for Heterogeneous Federated Continual Learning

Progressive Learning without Forgetting

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Federated Probability Memory Recall for Federated Continual Learning

Learn from Others and Be Yourself in Heterogeneous Federated Learning

Flashback: Understanding and Mitigating Forgetting in Federated Learning

Federated Continuous Learning With Broad Network Architecture

Knowledge Lock: Overcoming Catastrophic Forgetting in Federated Learning

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

Resource-Efficient Heterogenous Federated Continual Learning on Edge

FedFRR: Federated Forgetting-Resistant Representation Learning

Continual Federated Learning Based on Knowledge Distillation

Efficient Knowledge Management for Heterogeneous Federated Continual Learning on Resource-Constrained Edge Devices

Federated Continual Learning via Knowledge Fusion: A Survey

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental Learning

Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic Memory

Acceleration of Federated Learning with Alleviated Forgetting in Local Training

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

FedMeS: Personalized Federated Continual Learning Leveraging Local Memory