Abstract:Data collaboration enables multiple parties to pool data for deriving meaningful data insights. However, data misuse and unlawful data collection have led to precautionary measures being imposed by individual organizations to guide against data leakage and abuse. As a response, decentralized federated learning (DFL) has emerged as an attractive paradigm to facilitate data collaboration while being amenable to privacy-preserving data and knowledge sharing, cost reduction, and prediction accuracy improvement. Unfortunately, the participating parties in DFL tend to be heterogeneous with skew datasets and uneven capabilities. Inevitably, training and transmission costs, and the presence of free-riders pose challenges to the adoption and participation of DFL. The absence of centralized parameter servers further exacerbates the problem of evaluating the contribution of each individual party. Therefore, an effective incentive mechanism is essential to promote data collaboration. In this paper, we propose a novel Incentive-aware Decentralized fEderated leArning (IDEA) framework for facilitating data collaboration. Specifically, we first design a customizable reward scheme for heterogeneous parties to optimize their respective objectives such as higher model accuracy, communication efficiency, and computational efficiency. To reward fairly to deserving parties while offering flexibility, we propose a novel multi-agent reinforcement learning (MARL) incentive mechanism, which enables heterogeneous parties to learn their own optimal collaboration policy. We then design an efficient decentralized data collaboration algorithm that supports the customizable reward scheme based on individual objective-specific collaboration policy. We theoretically prove that the algorithm achieves a Nash equilibrium, which ensures the fairness of the corresponding rewards for parties. We conduct extensive experiments to evaluate the performance of our proposed framework against four baselines on five real-world datasets. The results show that IDEA outperforms state-of-the-art methods in terms of effectiveness, efficiency, and accumulated reward.

Incentive-Aware Decentralized Data Collaboration.

Self-Interested Agents in Collaborative Learning: An Incentivized Adaptive Data-Centric Framework

An Incentivized Federated Learning Model Based on Contract Theory

A Fairness-aware Incentive Scheme for Federated Learning.

Collaboration in Participant-Centric Federated Learning: A Game-Theoretical Perspective

Incentivizing Inclusive Data Contributions in Personalized Federated Learning

Efficient Core-selecting Incentive Mechanism for Data Sharing in Federated Learning

Incentive Mechanism Design for Federated Learning: Challenges and Opportunities

Incentive Mechanism Design for Federated Learning with Multi-Dimensional Private Information

Towards Fair Graph Federated Learning via Incentive Mechanisms

Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspective

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning

Adaptive incentive for cross-silo federated learning: A multi-agent reinforcement learning approach

Federated Learning Incentive Mechanism Design via Shapley Value and Pareto Optimality

A Comprehensive Survey of Incentive Mechanism for Federated Learning

Reliable Incentive Mechanism for Federated Learning of Electric Metering Data

A Game-Theoretic Framework for Incentive Mechanism Design in Federated Learning

Incentives in Private Collaborative Machine Learning

Reinforcement Learning Based Incentive Mechanism for Federated Meta Learning: A Game-Theoretic Perspective

A Sustainable Incentive Scheme for Federated Learning

Incentivizing Differentially Private Federated Learning: A Multidimensional Contract Approach