Abstract:During the training process of federated learning models, the domain information of the target test data on the server can differ greatly from the training data of each client, leading to a decrease in the performance of the federated model. Additionally, due to privacy protection during federated training, clients cannot see the target domain test data, and the distribution information of the target data cannot be used. This poses a new challenge for federated learning. Domain generalization techniques are often used in centralized frameworks to resolve such problems. In recent years, the domain generalization method based on feature decorrelation has enabled models to learn knowledge with a stronger generalization ability in unseen target domain data. However, existing methods require data centralization in the feature decorrelation process, which conflicts with data privacy protection in federated learning. To address these issues, we propose Reinforcement Federated Domain Generalization (RFDG), which incorporates domain generalization in federated learning via reinforcement learning. RFDG can improve the generalization ability of the federated model of unseen target domain test data. We design a reinforcement federated feature decorrelation policy that uses reinforcement learning technology to transform the sample reweight work into a parameterized sample reweight policy that can be shared among federated learning clients. We develop reinforcement federated experience replay techniques to supplement the feature information loss of local data due to the mini-batch mechanism during the policy learning process. When the policy is shared by each client, those features can be decorrelated from a global perspective, allowing the model to focus on capturing the fundamental association between features and labels to learn domain-invariant knowledge. We verified the effectiveness of our method through extensive experiments using four publicly available datasets.

Federated Domain Generalization via Prompt Learning and Aggregation

FedDGP: Disentangling Global and Personal Models for Federated Learning

Federated Domain Generalization with Generalization Adjustment

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

Harmonizing Generalization and Personalization in Federated Prompt Learning

Contrastive-enhanced Domain Generalization with Federated Learning

Efficiently Assemble Normalization Layers and Regularization for Federated Domain Generalization

Federated Learning with Domain Generalization

DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning

Personalized Federated Learning with Domain Generalization

Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generation

Mixture of Experts Made Personalized: Federated Prompt Learning for Vision-Language Models

FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization

Disentangled Prompt Representation for Domain Generalization

Visual Prompt Based Personalized Federated Learning

RFDG: Reinforcement Federated Domain Generalization

FedCCRL: Federated Domain Generalization with Cross-Client Representation Learning

Ensembling Disentangled Domain-Specific Prompts for Domain Generalization

Prototype-Decomposed Knowledge Distillation for Learning Generalized Federated Representation

Learning to Prompt Your Domain for Vision-Language Models

Federated Adaptive Prompt Tuning for Multi-Domain Collaborative Learning