Abstract:Federated Learning (FL) system needs to incentivize clients since they may be reluctant to participate in the resource consuming process. Existing incentive mechanisms fail to construct a sustainable environment for the long-term development of FL system: 1) They seldom focus on system economic properties (e.g., social welfare, individual rationality, and incentive compatibility) to guarantee client attraction. 2) Current online auction modeling methods divide the whole continual process into multiple independent rounds and solve them one-by-one, which breaks the correlation between each round. Besides, the inherent characteristics of FL system (model-agnostic and privacy-sensitive) also prevent it from the optimal strategy by precise mathematical analysis. 3) Current system modelings ignore the practical problem of periodical client shifting, which cannot adaptively update its strategy to handle system dynamics. To overcome the above challenges, this paper proposes a long-term adaptive Vickrey-Clarke-Groves (VCG) auction mechanism for FL system, which incorporate a multi-branch deep reinforcement learning (DRL) algorithm. First, VCG auction is the only one that can simultaneously guarantee all crucial economic properties. Second, we extend the economic properties to long-term forms and apply the experience-driven DRL algorithm to directly obtain long-term optimal strategy, without any prior system knowledge. Third, we reconstruct a multi-branch DRL network to accommodate periodical client shifting by adaptive decision head switching for different time periods. Finally, we theoretically prove he extended economic properties (i.e., IC) and conduct extensive experiments on several real-world datasets. Compared with state-of-the-art approaches, the long-term social welfare of FL system increases by 36% with a 37% reduction in payment. Besides, the multi-branch network can adaptively handle periodical client shifting on the timeline.

Shortest path core-selection incentive for federated learning platform with medical applications

A Federated Learning Framework Via Decentralized Data Valuation for Chronic Disease Healthcare

Efficient Core-selecting Incentive Mechanism for Data Sharing in Federated Learning

Incentive Framework for Cross-Device Federated Learning and Analytics with Multiple Tasks Based on a Multi-Leader-Follower Game

Long-Term Adaptive VCG Auction Mechanism for Sustainable Federated Learning with Periodical Client Shifting

A VCG-based Fair Incentive Mechanism for Federated Learning

Incentive Mechanism for Horizontal Federated Learning Based on Reputation and Reverse Auction

Online Auction-Based Incentive Mechanism Design for Horizontal Federated Learning with Budget Constraint

An Incentivized Federated Learning Model Based on Contract Theory

A Learning-Based Incentive Mechanism for Federated Learning

Incentive-driven Federated Learning in Mobile Edge Networks

Incentive-driven Long-Term Optimization for Hierarchical Federated Learning

Federated Learning Privacy Incentives: Reverse Auctions and Negotiations

Incentivizing Federated Learning under Long-Term Energy Constraint via Online Randomized Auctions

Federated Learning Optimization Algorithm Based on Incentive Mechanism

A Multi-Player Game for Studying Federated Learning Incentive Schemes

Toward Quality-Aware Reverse Auction-based Incentive Mechanism for Federated Learning

Game of Privacy: Towards Better Federated Platform Collaboration under Privacy Restriction

An Uncertainty-Aware Auction Mechanism for Federated Learning.

A Survey of Incentive Mechanism Design for Federated Learning

FedAB: Truthful Federated Learning with Auction-Based Combinatorial Multi-Armed Bandit