Abstract:Federated learning (FL) is a machine-learning setting, where multiple clients collaboratively train a model under the coordination of a central server. The clients' raw data are locally stored, and each client only uploads the trained weight to the server, which can mitigate the privacy risks from the centralized machine learning. However, most of the existing FL models focus on one-time learning without consideration for continuous learning. Continuous learning supports learning from streaming data continuously, so it can adapt to environmental changes and provide better real-time performance. In this article, we present a federated continuous learning scheme based on broad learning (FCL-BL) to support efficient and accurate federated continuous learning (FCL). In FCL-BL, we propose a weighted processing strategy to solve the catastrophic forgetting problem, so FCL-BL can handle continuous learning. Then, we develop a local-independent training solution to support fast and accurate training in FCL-BL. The proposed solution enables us to avoid using a time-consuming synchronous approach while addressing the inaccurate-training issue rooted in the previous asynchronous approach. Moreover, we introduce a batch-asynchronous approach and broad learning (BL) technique to guarantee the high efficiency of FCL-BL. Specifically, the batch-asynchronous approach reduces the number of client-server interaction rounds, and the BL technique supports incremental learning without retraining when learning newly produced data. Finally, theoretical analysis and experimental results further illustrate that FCL-BL is superior to the existing FL schemes in terms of efficiency and accuracy in FCL.

Towards Long-Term Remembering in Federated Continual Learning

Edge-cloud Collaborative Learning with Federated and Centralized Features

Resource-Efficient Heterogenous Federated Continual Learning on Edge

Efficient Knowledge Management for Heterogeneous Federated Continual Learning on Resource-Constrained Edge Devices

Federated Probability Memory Recall for Federated Continual Learning

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

Accurate Forgetting for Heterogeneous Federated Continual Learning

Federated Continuous Learning With Broad Network Architecture

Federated Continual Learning via Knowledge Fusion: A Survey

Cross-FCL: Toward a Cross-edge Federated Continual Learning Framework in Mobile Edge Computing Systems

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Variational Bayes for Federated Continual Learning

Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic Memory

Learn from Others and Be Yourself in Heterogeneous Federated Learning

FedMeS: Personalized Federated Continual Learning Leveraging Local Memory

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

Federated Continual Learning for Edge-AI: A Comprehensive Survey

FedFRR: Federated Forgetting-Resistant Representation Learning

Memory-adaptive Depth-wise Heterogenous Federated Learning

Traceable Federated Continual Learning

Addressing Spatial-Temporal Data Heterogeneity in Federated Continual Learning via Tail Anchor