Abstract:Federated learning aims to facilitate collaborative training among multiple clients with data heterogeneity in a privacy-preserving manner, which either generates the generalized model or develops personalized models. However, existing methods typically struggle to balance both directions, as optimizing one often leads to failure in another. To address the problem, this article presents a method named personalized federated learning via cross silo prototypical calibration (pFedCSPC) to enhance the consistency of knowledge of clients by calibrating features from heterogeneous spaces, which contributes to enhancing the collaboration effectiveness between clients. Specifically, pFedCSPC employs an adaptive aggregation method to offer personalized initial models to each client, enabling rapid adaptation to personalized tasks. Subsequently, pFedCSPC learns class representation patterns on clients by clustering, averages the representations within each cluster to form local prototypes, and aggregates them on the server to generate global prototypes. Meanwhile, pFedCSPC leverages global prototypes as knowledge to guide the learning of local representation, which is beneficial for mitigating the data imbalanced problem and preventing overfitting. Moreover, pFedCSPC has designed a cross-silo prototypical calibration (CSPC) module, which utilizes contrastive learning techniques to map heterogeneous features from different sources into a unified space. This can enhance the generalization ability of the global model. Experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis, and case study, and the results verified that pFedCSPC achieves improvements in both global generalization and local personalization performance via calibrating cross-source features and strengthening collaboration effectiveness, respectively.

Personalized Federated Learning with Layer-Wise Feature Transformation Via Meta-Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

Learn What You Need in Personalized Federated Learning

Personalized federated learning based on feature fusion

Towards Layer-Wise Personalized Federated Learning: Adaptive Layer Disentanglement via Conflicting Gradients

Improving Global Generalization and Local Personalization for Federated Learning

FedL2P: Federated Learning to Personalize

Personalized Federated Learning via Amortized Bayesian Meta-Learning

Federated Learning with Personalization Layers

FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data

Personalized Federated Learning with Adaptive Feature Aggregation and Knowledge Transfer

pFedLN: Personalized Federated Learning Framework With Layer-Wised and Neighbor-Based Aggregation for QoS Prediction

FedLF: Adaptive Logit Adjustment and Feature Optimization in Federated Long-Tailed Learning

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

Efficient Personalized Federated Learning via Sparse Model-Adaptation

FedCR: Personalized Federated Learning Based on Across-Client Common Representation with Conditional Mutual Information Regularization.

A Personalized Federated Learning Method Based on Clustering and Knowledge Distillation

Personalized Federated Learning with Adaptive Feature Extraction and Category Prediction in Non-IID Datasets

Personalized Federated Learning with Feature Alignment and Classifier Collaboration

Towards Personalized Federated Learning via Heterogeneous Model Reassembly