Abstract:Federated Learning (FL) is a distributed machine learning paradigm that achieves a globally robust model through decentralized computation and periodic model synthesis, primarily focusing on the global model's accuracy over aggregated datasets of all participating clients. Personalized Federated Learning (PFL) instead tailors exclusive models for each client, aiming to enhance the accuracy of clients' individual models on specific local data distributions. Despite of their wide adoption, existing FL and PFL works have yet to comprehensively address the class-imbalance issue, one of the most critical challenges within the realm of data heterogeneity in PFL and FL research. In this paper, we propose FedReMa, an efficient PFL algorithm that can tackle class-imbalance by 1) utilizing an adaptive inter-client co-learning approach to identify and harness different clients' expertise on different data classes throughout various phases of the training process, and 2) employing distinct aggregation methods for clients' feature extractors and classifiers, with the choices informed by the different roles and implications of these model components. Specifically, driven by our experimental findings on inter-client similarity dynamics, we develop critical co-learning period (CCP), wherein we introduce a module named maximum difference segmentation (MDS) to assess and manage task relevance by analyzing the similarities between clients' logits of their classifiers. Outside the CCP, we employ an additional scheme for model aggregation that utilizes historical records of each client's most relevant peers to further enhance the personalization stability. We demonstrate the superiority of our FedReMa in extensive experiments.

Reputation-Aware Federated Learning Client Selection based on Stochastic Integer Programming

Fairness-Aware Client Selection for Federated Learning

Client Selection in Federated Learning: Principles, Challenges, and Opportunities

Stochastic Client Selection for Federated Learning with Volatile Clients

Welfare and Fairness Dynamics in Federated Learning: A Client Selection Perspective

Addressing Heterogeneity in Federated Learning with Client Selection via Submodular Optimization

A Truthful and Reliable Incentive Mechanism for Federated Learning Based on Reputation Mechanism and Reverse Auction

Submodular Maximization Approaches for Equitable Client Selection in Federated Learning

Contribution‐based Federated Learning client selection

DPP-based Client Selection for Federated Learning with Non-IID Data

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

A Snapshot of the Frontiers of Client Selection in Federated Learning

A Review of Client Selection Methods in Federated Learning

A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

Smart client selection strategies for enhanced federated learning in digital healthcare applications

FedMint: Intelligent Bilateral Client Selection in Federated Learning with Newcomer IoT Devices

Asynchronous Wireless Federated Learning with Probabilistic Client Selection

Context-Aware Online Client Selection for Hierarchical Federated Learning

A Reputation Mechanism Is All You Need: Collaborative Fairness and Adversarial Robustness in Federated Learning

Tackling Selfish Clients in Federated Learning