Abstract:Federated learning is a powerful technique that enables collaborative learning among different clients. Prototype-based federated learning is a specific approach that improves the performance of local models by integrating class prototypes. However, prototype-based federated learning faces several challenges, such as prototype redundancy and prototype failure, which can limit its accuracy. In addition, it is also susceptible to poisoning attacks and server malfunction, which can degrade the quality of prototypes. To address these issues, we propose FedRFQ, a prototype-based federated learning approach that aims to reduce redundancy, minimize failure, and improve quality. FedRFQ leverages the SoftPool mechanism with prototype-based federated learning, which effectively mitigates prototype redundancy and prototype failure on Non-IID data. Moreover, we introduce the BFT-detect algorithm, a BFT detectable aggregation algorithm, to ensure the security of FedRFQ against poisoning attacks and server malfunction. Finally, we conducted experiments on three different datasets, namely MNIST, FEMNIST, and CIFAR-10. The results demonstrate that FedRFQ outperforms existing baselines in terms of accuracy when handling Non-IID data.

What problem does this paper attempt to address?

The paper attempts to address the following issues: 1. **Prototype Redundancy**: - In prototype-based federated learning, when the performance of a local model trained with fewer prototype parameters is comparable to that trained with more prototype parameters, the extra prototype parameters are considered redundant. This redundancy increases communication overhead and the computational burden on the server. 2. **Prototype Failure**: - Prototype failure refers to an abnormal distance relationship between local prototypes and global prototypes. Specifically, the distance (L2 distance) between local prototypes and global prototypes of the same category should be smaller than the distance between local prototypes and global prototypes of different categories. However, in some cases, this relationship is broken, leading to prototype failure. 3. **Low Prototype Quality**: - Due to poisoning attacks from clients or server failures, the quality of the generated prototypes may be low, which can damage training results and reduce accuracy. To address these issues, the paper proposes **FedRFQ**, a prototype-based federated learning method that solves the problems through the following means: - **Reducing Redundancy and Minimizing Failure**: - Introduces the SoftPool mechanism, which effectively reduces prototype redundancy and prototype failure, especially when dealing with non-independent and identically distributed (Non-IID) data. - **Enhancing Security**: - Develops a BFT-detect aggregation algorithm to ensure the secure aggregation of local prototypes in the presence of poisoning attacks and server failures. - **Improving Model Accuracy**: - Experimental results show that FedRFQ has higher accuracy compared to existing baseline methods when handling Non-IID data.

FedRFQ: Prototype-Based Federated Learning with Reduced Redundancy, Minimal Failure, and Enhanced Quality

FedRFQ: Prototype-Based Federated Learning with Reduced Redundancy, Minimal Failure, and Enhanced Quality

FedProc: Prototypical contrastive federated learning on Non-IID data

An Enhanced Federated Prototype Learning Method under Domain Shift

A Prototype-Based Knowledge Distillation Framework for Heterogeneous Federated Learning

Tackling Data Heterogeneity in Federated Learning with Class Prototypes

Enhancing Federated Learning by One-Shot Transferring of Intermediate Features from Clients

FedRAD: Heterogeneous Federated Learning via Relational Adaptive Distillation

Boosting Federated Learning Convergence with Prototype Regularization

HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learning

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

Dynamic Heterogeneous Federated Learning with Multi-Level Prototypes

Robust Federated Opportunistic Learning in the Presence of Label Quality Disparity

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

FedHide: Federated Learning by Hiding in the Neighbors

Fed-Credit: Robust Federated Learning with Credibility Management

DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning

R $^{2}$ Fed: Resilient Reinforcement Federated Learning for Industrial Applications

BAFFLE: A Baseline of Backpropagation-Free Federated Learning

Data Quality-Aware Client Selection in Heterogeneous Federated Learning