Abstract:Federated learning aims to facilitate collaborative training among multiple clients with data heterogeneity in a privacy-preserving manner, which either generates the generalized model or develops personalized models. However, existing methods typically struggle to balance both directions, as optimizing one often leads to failure in another. To address the problem, this article presents a method named personalized federated learning via cross silo prototypical calibration (pFedCSPC) to enhance the consistency of knowledge of clients by calibrating features from heterogeneous spaces, which contributes to enhancing the collaboration effectiveness between clients. Specifically, pFedCSPC employs an adaptive aggregation method to offer personalized initial models to each client, enabling rapid adaptation to personalized tasks. Subsequently, pFedCSPC learns class representation patterns on clients by clustering, averages the representations within each cluster to form local prototypes, and aggregates them on the server to generate global prototypes. Meanwhile, pFedCSPC leverages global prototypes as knowledge to guide the learning of local representation, which is beneficial for mitigating the data imbalanced problem and preventing overfitting. Moreover, pFedCSPC has designed a cross-silo prototypical calibration (CSPC) module, which utilizes contrastive learning techniques to map heterogeneous features from different sources into a unified space. This can enhance the generalization ability of the global model. Experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis, and case study, and the results verified that pFedCSPC achieves improvements in both global generalization and local personalization performance via calibrating cross-source features and strengthening collaboration effectiveness, respectively.

Federated Learning FedLTailor: A Dynamic Weight Adjustment and Personalized Fusion Approach

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedLF: Adaptive Logit Adjustment and Feature Optimization in Federated Long-Tailed Learning

FedTAIL: A Federated Learning Approach with Trans-Architecture Intermediate Links

FedFTHA: A Fine-Tuning and Head Aggregation Method in Federated Learning

Personalized Federated Learning with Layer-Wise Feature Transformation Via Meta-Learning

FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data

Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation

Fusion of Global and Local Knowledge for Personalized Federated Learning

Federated Learning for Assigning Weights to Clients on Long-Tailed Data

Addressing Spatial-Temporal Data Heterogeneity in Federated Continual Learning via Tail Anchor

FedAGA: A federated learning framework for enhanced inter-client relationship learning

Improving Global Generalization and Local Personalization for Federated Learning

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

Fine-tuning Global Model Via Data-Free Knowledge Distillation for Non-IID Federated Learning

UPFL: Unsupervised Personalized Federated Learning Towards New Clients

Improving Generalization and Personalization in Model-Heterogeneous Federated Learning

FedAS: Bridging Inconsistency in Personalized Federated Learning

Learn What You Need in Personalized Federated Learning

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.