Abstract:Incentive mechanism is crucial for federated learning (FL) when rational clients do not have the same interests in the global model as the server. However, due to system heterogeneity and limited budget, it is generally impractical for the server to incentivize all clients to participate in all training rounds (known as full participation). The existing FL incentive mechanisms are typically designed by stimulating a fixed subset of clients based on their data quantity or system resources. Hence, FL is performed only using this subset of clients throughout the entire training process, leading to a biased model because of data heterogeneity. This paper proposes a game theoretic incentive mechanism for FL with randomized client participation, where the server adopts a customized pricing strategy that motivates different clients to join with different participation levels (probabilities) for obtaining an unbiased and high performance model. Each client responds to the server's monetary incentive by choosing its best participation level, to maximize its profit based on not only the incurred local cost but also its intrinsic value for the global model. To effectively evaluate clients' contribution to the model performance, we derive a new convergence bound which analytically predicts how clients' arbitrary participation levels and their heterogeneous data affect the model performance. By solving a non-convex optimization problem, our analysis reveals that the intrinsic value leads to the interesting possibility of bidirectional payment between the server and clients. Experimental results using real datasets on a hardware prototype demonstrate the superiority of our mechanism in achieving higher model performance for the server as well as higher profits for the clients.

Long-term Incentive Mechanism for Federated Learning: A Dynamic Repeated Game Approach

Incentive Mechanisms in Federated Learning and A Game-Theoretical Approach

Incentive Mechanism Design for Federated Learning: A Two-stage Stackelberg Game Approach.

A Game-Theoretic Framework for Incentive Mechanism Design in Federated Learning

Reinforcement Learning Based Incentive Mechanism for Federated Meta Learning: A Game-Theoretic Perspective

An Incentive Mechanism for Long-Term Federated Learning in Autonomous Driving

Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspective

A Cooperative Analysis to Incentivize Communication-Efficient Federated Learning

Incentive Framework for Cross-Device Federated Learning and Analytics with Multiple Tasks Based on a Multi-Leader-Follower Game

A Multi-Player Game for Studying Federated Learning Incentive Schemes

An Incentive Mechanism Based on AoU, Data Quality, and Data Quantity for Federated Learning

A Hierarchical Incentive Mechanism for Coded Federated Learning

Incentive Mechanism Design for Federated Learning with Stackelberg Game Perspective in the Industrial Scenario

Incentive Mechanism Design for Federated Learning in Multi-access Edge Computing.

Adaptive incentive for cross-silo federated learning: A multi-agent reinforcement learning approach

A Learning-Based Incentive Mechanism for Federated Learning

Portfolio-Based Incentive Mechanism Design for Cross-Device Federated Learning

Incentive Mechanism for Federated Learning with Random Client Selection

Incentive Mechanism Design for Unbiased Federated Learning with Randomized Client Participation

Federated Learning Incentive Mechanism Design via Shapley Value and Pareto Optimality

An Incentive Mechanism for Federated Learning Based on Multiple Resource Exchange