Abstract:Federated Learning (FL) system needs to incentivize clients since they may be reluctant to participate in the resource consuming process. Existing incentive mechanisms fail to construct a sustainable environment for the long-term development of FL system: 1) They seldom focus on system economic properties (e.g., social welfare, individual rationality, and incentive compatibility) to guarantee client attraction. 2) Current online auction modeling methods divide the whole continual process into multiple independent rounds and solve them one-by-one, which breaks the correlation between each round. Besides, the inherent characteristics of FL system (model-agnostic and privacy-sensitive) also prevent it from the optimal strategy by precise mathematical analysis. 3) Current system modelings ignore the practical problem of periodical client shifting, which cannot adaptively update its strategy to handle system dynamics. To overcome the above challenges, this paper proposes a long-term adaptive Vickrey-Clarke-Groves (VCG) auction mechanism for FL system, which incorporate a multi-branch deep reinforcement learning (DRL) algorithm. First, VCG auction is the only one that can simultaneously guarantee all crucial economic properties. Second, we extend the economic properties to long-term forms and apply the experience-driven DRL algorithm to directly obtain long-term optimal strategy, without any prior system knowledge. Third, we reconstruct a multi-branch DRL network to accommodate periodical client shifting by adaptive decision head switching for different time periods. Finally, we theoretically prove he extended economic properties (i.e., IC) and conduct extensive experiments on several real-world datasets. Compared with state-of-the-art approaches, the long-term social welfare of FL system increases by 36% with a 37% reduction in payment. Besides, the multi-branch network can adaptively handle periodical client shifting on the timeline.

Incentivizing Federated Learning under Long-Term Energy Constraint via Online Randomized Auctions

A Truthful Procurement Auction for Incentivizing Heterogeneous Clients in Federated Learning

An Incentive Mechanism for Federated Learning in Wireless Cellular network: An Auction Approach

Incentive-driven Federated Learning in Mobile Edge Networks

Performance-Based Pricing for Federated Learning via Auction

A Multi-Dimensional Reverse Auction Mechanism for Volatile Federated Learning in the Mobile Edge Computing Systems

FedAB: Truthful Federated Learning with Auction-Based Combinatorial Multi-Armed Bandit

Incentive-driven Long-Term Optimization for Hierarchical Federated Learning

Long-Term Adaptive VCG Auction Mechanism for Sustainable Federated Learning with Periodical Client Shifting

Energy Efficient Federated Learning in Internet of Vehicles: A Game Theoretic Scheme

Incentive Mechanism Design for Unbiased Federated Learning with Randomized Client Participation

Incentive-Aware Resource Allocation for Multiple Model Owners in Federated Learning

Incentive Mechanism for Federated Learning with Random Client Selection

BARA: Efficient Incentive Mechanism with Online Reward Budget Allocation in Cross-Silo Federated Learning

Cost-Aware Federated Learning in Mobile Edge Networks

Dynamic Pricing for Client Recruitment in Federated Learning

Energy-Aware Incentive Mechanism for Hierarchical Federated Learning Using Water Filling Technique

Incentive Mechanisms in Federated Learning and A Game-Theoretical Approach

Federated Learning Incentive Mechanism under Buyers' Auction Market

FIFL: A Fair Incentive Mechanism for Federated Learning

An Incentive Mechanism for Federated Learning Based on Multiple Resource Exchange