Abstract:Federated learning (FL) is a machine-learning setting, where multiple clients collaboratively train a model under the coordination of a central server. The clients' raw data are locally stored, and each client only uploads the trained weight to the server, which can mitigate the privacy risks from the centralized machine learning. However, most of the existing FL models focus on one-time learning without consideration for continuous learning. Continuous learning supports learning from streaming data continuously, so it can adapt to environmental changes and provide better real-time performance. In this article, we present a federated continuous learning scheme based on broad learning (FCL-BL) to support efficient and accurate federated continuous learning (FCL). In FCL-BL, we propose a weighted processing strategy to solve the catastrophic forgetting problem, so FCL-BL can handle continuous learning. Then, we develop a local-independent training solution to support fast and accurate training in FCL-BL. The proposed solution enables us to avoid using a time-consuming synchronous approach while addressing the inaccurate-training issue rooted in the previous asynchronous approach. Moreover, we introduce a batch-asynchronous approach and broad learning (BL) technique to guarantee the high efficiency of FCL-BL. Specifically, the batch-asynchronous approach reduces the number of client-server interaction rounds, and the BL technique supports incremental learning without retraining when learning newly produced data. Finally, theoretical analysis and experimental results further illustrate that FCL-BL is superior to the existing FL schemes in terms of efficiency and accuracy in FCL.

Traceable Federated Continual Learning

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Asynchronous Federated Continual Learning

Federated Continuous Learning With Broad Network Architecture

Federated Continual Learning via Knowledge Fusion: A Survey

Federated Probability Memory Recall for Federated Continual Learning

FedMeS: Personalized Federated Continual Learning Leveraging Local Memory

Federated Continual Learning for Text Classification via Selective Inter-client Transfer

Parameterizing Federated Continual Learning for Reproducible Research

Accurate Forgetting for Heterogeneous Federated Continual Learning

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

Pfedeff: an Efficient and Personalized Federated Cognitive Learning Framework in Multi-agent Systems

CoFED: Cross-silo Heterogeneous Federated Multi-task Learning via Co-training

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model.

Federated Learning from Pre-Trained Models: A Contrastive Learning Approach

Concept Matching: Clustering-based Federated Continual Learning

FL-Clip: Bridging Plasticity and Stability in Pre-Trained Federated Class-Incremental Learning Models

Cross-FCL: Toward a Cross-edge Federated Continual Learning Framework in Mobile Edge Computing Systems

Federated Class-Incremental Learning with New-Class Augmented Self-Distillation