Abstract:Federated learning (FL) is a machine-learning setting, where multiple clients collaboratively train a model under the coordination of a central server. The clients' raw data are locally stored, and each client only uploads the trained weight to the server, which can mitigate the privacy risks from the centralized machine learning. However, most of the existing FL models focus on one-time learning without consideration for continuous learning. Continuous learning supports learning from streaming data continuously, so it can adapt to environmental changes and provide better real-time performance. In this article, we present a federated continuous learning scheme based on broad learning (FCL-BL) to support efficient and accurate federated continuous learning (FCL). In FCL-BL, we propose a weighted processing strategy to solve the catastrophic forgetting problem, so FCL-BL can handle continuous learning. Then, we develop a local-independent training solution to support fast and accurate training in FCL-BL. The proposed solution enables us to avoid using a time-consuming synchronous approach while addressing the inaccurate-training issue rooted in the previous asynchronous approach. Moreover, we introduce a batch-asynchronous approach and broad learning (BL) technique to guarantee the high efficiency of FCL-BL. Specifically, the batch-asynchronous approach reduces the number of client-server interaction rounds, and the BL technique supports incremental learning without retraining when learning newly produced data. Finally, theoretical analysis and experimental results further illustrate that FCL-BL is superior to the existing FL schemes in terms of efficiency and accuracy in FCL.

Learn from Others and Be Yourself in Heterogeneous Federated Learning

Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Completely Heterogeneous Federated Learning

Accurate Forgetting for Heterogeneous Federated Continual Learning

Federated Continual Learning via Knowledge Fusion: A Survey

Federated Continuous Learning With Broad Network Architecture

Resource-Efficient Heterogenous Federated Continual Learning on Edge

Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental Learning

Efficient Knowledge Management for Heterogeneous Federated Continual Learning on Resource-Constrained Edge Devices

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

Continual Federated Learning Based on Knowledge Distillation

Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning

Continual Horizontal Federated Learning for Heterogeneous Data

Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

Clustered Federated Learning in Heterogeneous Environment.

Federated Impression for Learning with Distributed Heterogeneous Data

Privacy preserving federated learning for full heterogeneity

Cross-silo Heterogeneous Model Federated Multitask Learning

Towards Addressing Heterogeneity Of Data In Federated Learning