Abstract:Federated learning aims to facilitate collaborative training among multiple clients with data heterogeneity in a privacy-preserving manner, which either generates the generalized model or develops personalized models. However, existing methods typically struggle to balance both directions, as optimizing one often leads to failure in another. To address the problem, this article presents a method named personalized federated learning via cross silo prototypical calibration (pFedCSPC) to enhance the consistency of knowledge of clients by calibrating features from heterogeneous spaces, which contributes to enhancing the collaboration effectiveness between clients. Specifically, pFedCSPC employs an adaptive aggregation method to offer personalized initial models to each client, enabling rapid adaptation to personalized tasks. Subsequently, pFedCSPC learns class representation patterns on clients by clustering, averages the representations within each cluster to form local prototypes, and aggregates them on the server to generate global prototypes. Meanwhile, pFedCSPC leverages global prototypes as knowledge to guide the learning of local representation, which is beneficial for mitigating the data imbalanced problem and preventing overfitting. Moreover, pFedCSPC has designed a cross-silo prototypical calibration (CSPC) module, which utilizes contrastive learning techniques to map heterogeneous features from different sources into a unified space. This can enhance the generalization ability of the global model. Experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis, and case study, and the results verified that pFedCSPC achieves improvements in both global generalization and local personalization performance via calibrating cross-source features and strengthening collaboration effectiveness, respectively.

Personalized Federated Learning with Local Optimization Models

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning

Learn What You Need in Personalized Federated Learning

Personalized Federated Learning with First Order Model Optimization

Improving Global Generalization and Local Personalization for Federated Learning

Personalized Federated Learning with Inferred Collaboration Graphs.

Efficient Personalized Federated Learning via Sparse Model-Adaptation

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

Personalized Federated Learning with Local Attention

Client-supervised Federated Learning: Towards One-model-for-all Personalization

FedL2P: Federated Learning to Personalize

PGFed: Personalize Each Client's Global Objective for Federated Learning

Personalized federated learning based on feature fusion

FedFTHA: A Fine-Tuning and Head Aggregation Method in Federated Learning

Personalized Federated Learning through Local Memorization

A Personalized Federated Learning Method Based on Clustering and Knowledge Distillation

Personalizing or Not: Dynamically Personalized Federated Learning with Incentives

Decentralized Personalized Online Federated Learning

FedPHP: Federated Personalization with Inherited Private Models