Abstract:Personalized federated learning (PFL) reduces the impact of non-independent and identically distributed (non-IID) data among clients by allowing each client to train a personalized model when collaborating with others. A key question in PFL is to decide which parameters of a client should be localized or shared with others. In current mainstream approaches, all layers that are sensitive to non-IID data (such as classifier layers) are generally personalized. The reasoning behind this approach is understandable, as localizing parameters that are easily influenced by non-IID data can prevent the potential negative effect of collaboration. However, we believe that this approach is too conservative for collaboration. For example, for a certain client, even if its parameters are easily influenced by non-IID data, it can still benefit by sharing these parameters with clients having similar data distribution. This observation emphasizes the importance of considering not only the sensitivity to non-IID data but also the similarity of data distribution when determining which parameters should be localized in PFL. This paper introduces a novel guideline for client collaboration in PFL. Unlike existing approaches that prohibit all collaboration of sensitive parameters, our guideline allows clients to share more parameters with others, leading to improved model performance. Additionally, we propose a new PFL method named FedCAC, which employs a quantitative metric to evaluate each parameter's sensitivity to non-IID data and carefully selects collaborators based on this evaluation. Experimental results demonstrate that FedCAC enables clients to share more parameters with others, resulting in superior performance compared to state-of-the-art methods, particularly in scenarios where clients have diverse distributions.

CosPer: An adaptive personalized approach for enhancing fairness and robustness of federated learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedAPEN: Personalized Cross-silo Federated Learning with Adaptability to Statistical Heterogeneity

FedCos: A Scene-adaptive Federated Optimization Enhancement for Performance Improvement

Pfedsim: Similarity-Aware Model Aggregation Towards Personalized Federated Learning.

Multi-level Personalized Federated Learning on Heterogeneous and Long-Tailed Data

Personalized Federated Learning with Adaptive Feature Aggregation and Knowledge Transfer

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

Bold but Cautious: Unlocking the Potential of Personalized Federated Learning through Cautiously Aggressive Collaboration

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

Client-supervised Federated Learning: Towards One-model-for-all Personalization

Personalized Federated Learning on Heterogeneous and Long-Tailed Data via Expert Collaborative Learning

Sparse Personalized Federated Learning

GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning

Dual Calibration-based Personalised Federated Learning

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

CPPer-FL: Clustered Parallel Training for Efficient Personalized Federated Learning

Robust Personalized Federated Learning with Sparse Penalization*

Multiple Adaptive Prototypes Learning in Personalized Federated Learning

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization