Abstract:Federated learning (FL) emerges as a promising paradigm to enable a federation of clients to train a machine learning model in a privacy-preserving manner. Most existing works assumed that the central parameter server (PS) determines the participation of clients implying that clients cannot make autonomous participation decisions. The above assumption is unrealistic because the participation in FL training may incur various cost and clients also have strong desire to be rewarded for participation. To address this problem, we design a novel autonomous client participation scheme to incentivize clients. Specifically, the PS provides a certain reward shared among participating clients for each training round. Clients decide whether to participate each FL training round or not based on their own utilities (i.e., reward minus cost). The process can be modeled as a minority game (MG) with incomplete information and clients end up in the minority side win after each training round because the reward of each participating client may not cover its cost if too many clients participate and vice verse. The challenge of autonomous participation schemes lies in lowering the volatility of participating clients in each round due to the lack of coordination among clients. Through solid analysis, we prove that: 1) The volatility of participating clients in each round is very high under the standard MG scheme. 2) The volatility of participating clients can be reduced significantly under the stochastic MG scheme. 3) A coalition based MG is proposed, which can further reduce the volatility in each round. By conducting extensive experiments in real settings, we demonstrate that the stochastic MG-based scheme outperforms other state-of-the-art algorithms in terms of utility and volatility, and the coalition MG-based client participation scheme can further boost the utility by 39%-48% and reduce the volatility by 51%-100%. Moreover, our algorithms can achieve almost the same model accuracy as that obtained by centralized client participation algorithms.

Client Selection in Federated Learning: A Dynamic Matching-Based Incentive Mechanism

Incentive Mechanism for Federated Learning with Random Client Selection

Welfare and Fairness Dynamics in Federated Learning: A Client Selection Perspective

Incentive-Aware Autonomous Client Participation in Federated Learning

Incentive Mechanism Design for Unbiased Federated Learning with Randomized Client Participation

Client Selection in Federated Learning: Principles, Challenges, and Opportunities

IMFL-AIGC: Incentive Mechanism Design for Federated Learning Empowered by Artificial Intelligence Generated Content

Incentive Mechanism for Federated Learning Based on Random Client Sampling.

A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

CAIM: A Context-Aware Incentive Mechanism for Robust Federated Learning.

Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective

Incentive Mechanism Design for Federated Learning in Multi-access Edge Computing.

IP-FL: Incentivized and Personalized Federated Learning

Fairness-Aware Client Selection for Federated Learning

An Incentive Mechanism for Federated Learning Based on Multiple Resource Exchange

Tackling Mavericks in Federated Learning via Adaptive Client Selection Strategy

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning

A Contract Theory based Incentive Mechanism for Federated Learning

Deep Reinforcement Learning Assisted Client Selection in Non-orthogonal Multiple Access based Federated Learning

Asynchronous Federated Learning with Incentive Mechanism Based on Contract Theory