Abstract:Federated learning enables multiple clients to collaboratively train a global model without revealing their local data. However, conventional federated learning often overlooks the fact that data stored on different clients may originate from diverse domains, and the resulting domain shift problem can significantly impair the performance of the global model. In this paper, we introduce Federated Semantic Prototype Learning (FedSeProto), a semantic prototype-based approach designed to address the domain shift issue in federated learning. The proposed method comprises two components: feature decoupling and feature alignment. Feature decoupling aims to learn semantic prototypes that can represent semantic information associated with specific categories, while feature alignment utilizes these semantic prototypes to facilitate learning of cross-client consistent features. Two key techniques are employed to achieve feature decoupling. On one hand, feature separation is achieved through the minimization of mutual information between semantic and domain features. On the other hand, the knowledge distillation is leveraged to ensure that both semantic and domain features carry the correct information. For feature alignment, intra-class semantic features are used to generate the local prototypes, which are further aggregated to the global prototypes. These global prototypes serve as guides during the local training process. Specifically, the local intra-class semantic features are driven to close to the corresponding global prototypes, thereby encouraging all clients to learn the globally consistent semantic features. Comprehensive experiments conducted on four challenging multi-domain datasets demonstrate the effectiveness of the proposed method compared with existing federated learning algorithms.

Boosting Federated Learning Convergence with Prototype Regularization

Prototype Helps Federated Learning: Towards Faster Convergence

FedProto: Federated Prototype Learning across Heterogeneous Clients

An Enhanced Federated Prototype Learning Method under Domain Shift

Tackling Data Heterogeneity in Federated Learning with Class Prototypes

Prototype Guided Federated Learning of Visual Feature Representations

Prototype-Decomposed Knowledge Distillation for Learning Generalized Federated Representation

Feature Norm Regularized Federated Learning: Utilizing Data Disparities for Model Performance Gains

Federated Learning with Regularized Client Participation

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

Dynamic heterogeneous federated learning with multi-level prototypes

ProtoFL: Unsupervised Federated Learning via Prototypical Distillation

Federated Learning With l1 Regularization

Adaptive Control of Client Selection and Gradient Compression for Efficient Federated Learning

Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training

Improving Generalization and Personalization in Model-Heterogeneous Federated Learning

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

Adaptive Block-Wise Regularization and Knowledge Distillation for Enhancing Federated Learning

Prototype Similarity Distillation for Communication-Efficient Federated Unsupervised Representation Learning

On the Convergence of Federated Averaging under Partial Participation for Over-parameterized Neural Networks

FedSeProto: Learning Semantic Prototype in Federated Learning