Abstract:Federated Learning (FL) has gained considerable attention recently, as it allows clients to cooperatively train a global machine learning model without sharing raw data. However, its performance can be compromised due to the high heterogeneity in clients' local data distributions, commonly known as Non-IID (non-independent and identically distributed). Moreover, collaboration among highly dissimilar clients exacerbates this performance degradation. Personalized FL seeks to mitigate this by enabling clients to collaborate primarily with others who have similar data characteristics, thereby producing personalized models. We noticed that existing methods for assessing model similarity often do not capture the genuine relevance of client domains. In response, our paper enhances personalized client collaboration in FL by introducing a metric for domain relevance between clients. Specifically, to facilitate optimal coalition formation, we measure the marginal contributions of client models using coalition game theory, providing a more accurate representation of potential client domain relevance within the FL privacy-preserving framework. Based on this metric, we then adjust each client's coalition membership and implement a personalized FL aggregation algorithm that is robust to Non-IID data domain. We provide a theoretical analysis of the algorithm's convergence and generalization capabilities. Our extensive evaluations on multiple datasets, including MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100, and under varying Non-IID data distributions (Pathological and Dirichlet), demonstrate that our personalized collaboration approach consistently outperforms contemporary benchmarks in terms of accuracy for individual clients.

Personalizing or Not: Dynamically Personalized Federated Learning with Incentives

IP-FL: Incentivized and Personalized Federated Learning

FedL2P: Federated Learning to Personalize

Personalized Federated Learning with Adaptive Feature Aggregation and Knowledge Transfer

Personalized Federated Learning with First Order Model Optimization

Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training

Incentivizing Inclusive Data Contributions in Personalized Federated Learning

Feed: Towards Personalization-Effective Federated Learning

Group Personalized Federated Learning

Partially Personalized Federated Learning: Breaking the Curse of Data Heterogeneity

Rethinking Personalized Client Collaboration in Federated Learning

FedPHP: Federated Personalization with Inherited Private Models

Exploring Personalization Via Federated Representation Learning on Non-Iid Data.

UA-PDFL: A Personalized Approach for Decentralized Federated Learning

Client-supervised Federated Learning: Towards One-model-for-all Personalization

Learn What You Need in Personalized Federated Learning

Efficient Personalized Federated Learning on Selective Model Training

PRIOR: Personalized Prior for Reactivating the Information Overlooked in Federated Learning

A Closer Look at Personalization in Federated Image Classification

Enhancing Group Fairness in Federated Learning through Personalization

Can Fair Federated Learning reduce the need for Personalisation?