Abstract:Federated learning aims to facilitate collaborative training among multiple clients with data heterogeneity in a privacy-preserving manner, which either generates the generalized model or develops personalized models. However, existing methods typically struggle to balance both directions, as optimizing one often leads to failure in another. To address the problem, this article presents a method named personalized federated learning via cross silo prototypical calibration (pFedCSPC) to enhance the consistency of knowledge of clients by calibrating features from heterogeneous spaces, which contributes to enhancing the collaboration effectiveness between clients. Specifically, pFedCSPC employs an adaptive aggregation method to offer personalized initial models to each client, enabling rapid adaptation to personalized tasks. Subsequently, pFedCSPC learns class representation patterns on clients by clustering, averages the representations within each cluster to form local prototypes, and aggregates them on the server to generate global prototypes. Meanwhile, pFedCSPC leverages global prototypes as knowledge to guide the learning of local representation, which is beneficial for mitigating the data imbalanced problem and preventing overfitting. Moreover, pFedCSPC has designed a cross-silo prototypical calibration (CSPC) module, which utilizes contrastive learning techniques to map heterogeneous features from different sources into a unified space. This can enhance the generalization ability of the global model. Experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis, and case study, and the results verified that pFedCSPC achieves improvements in both global generalization and local personalization performance via calibrating cross-source features and strengthening collaboration effectiveness, respectively.

Dynamic heterogeneous federated learning with multi-level prototypes

Dynamic Heterogeneous Federated Learning with Multi-Level Prototypes

Addressing Skewed Heterogeneity via Federated Prototype Rectification with Personalization

An Enhanced Federated Prototype Learning Method under Domain Shift

Rethinking Federated Learning with Domain Shift: A Prototype View

Tackling Data Heterogeneity in Federated Learning with Class Prototypes

Privacy preserving federated learning for full heterogeneity

Federated Graph Learning under Domain Shift with Generalizable Prototypes

Completely Heterogeneous Federated Learning

A Prototype-Based Knowledge Distillation Framework for Heterogeneous Federated Learning

Prototype Helps Federated Learning: Towards Faster Convergence

Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data Domains

Multi-level Personalized Federated Learning on Heterogeneous and Long-Tailed Data

Global prototype distillation for heterogeneous federated learning

FedProto: Federated Prototype Learning across Heterogeneous Clients

Prototype-Decomposed Knowledge Distillation for Learning Generalized Federated Representation

An Efficient and Security Federated Learning for Data Heterogeneity

A Hybrid Federated Learning Framework with Dynamic Task Allocation for Multi-Party Distributed Load Prediction

Improving Global Generalization and Local Personalization for Federated Learning

Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning