Abstract:Federated learning aims to facilitate collaborative training among multiple clients with data heterogeneity in a privacy-preserving manner, which either generates the generalized model or develops personalized models. However, existing methods typically struggle to balance both directions, as optimizing one often leads to failure in another. To address the problem, this article presents a method named personalized federated learning via cross silo prototypical calibration (pFedCSPC) to enhance the consistency of knowledge of clients by calibrating features from heterogeneous spaces, which contributes to enhancing the collaboration effectiveness between clients. Specifically, pFedCSPC employs an adaptive aggregation method to offer personalized initial models to each client, enabling rapid adaptation to personalized tasks. Subsequently, pFedCSPC learns class representation patterns on clients by clustering, averages the representations within each cluster to form local prototypes, and aggregates them on the server to generate global prototypes. Meanwhile, pFedCSPC leverages global prototypes as knowledge to guide the learning of local representation, which is beneficial for mitigating the data imbalanced problem and preventing overfitting. Moreover, pFedCSPC has designed a cross-silo prototypical calibration (CSPC) module, which utilizes contrastive learning techniques to map heterogeneous features from different sources into a unified space. This can enhance the generalization ability of the global model. Experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis, and case study, and the results verified that pFedCSPC achieves improvements in both global generalization and local personalization performance via calibrating cross-source features and strengthening collaboration effectiveness, respectively.

Bilateral Improvement in Local Personalization and Global Generalization in Federated Learning.

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Improving Generalization and Personalization in Model-Heterogeneous Federated Learning

Improving Global Generalization and Local Personalization for Federated Learning

FedCR: Personalized Federated Learning Based on Across-Client Common Representation with Conditional Mutual Information Regularization.

Personalized Federated Learning with Local Attention

Personalized Federated Contrastive Learning.

FedTC: A Personalized Federated Learning Method with Two Classifiers

Sparse Personalized Federated Learning

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

FedAS: Bridging Inconsistency in Personalized Federated Learning

Dual Calibration-based Personalised Federated Learning

CD^2-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learning

Client-supervised Federated Learning: Towards One-model-for-all Personalization

FedALA: Adaptive Local Aggregation for Personalized Federated Learning

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

CFPA: Cognitive Federated Partial Adaptation for Effective Personalization

Feed: Towards Personalization-Effective Federated Learning

FedL2P: Federated Learning to Personalize

Rethinking Personalized Client Collaboration in Federated Learning