Abstract:Data collaboration enables multiple parties to pool data for deriving meaningful data insights. However, data misuse and unlawful data collection have led to precautionary measures being imposed by individual organizations to guide against data leakage and abuse. As a response, decentralized federated learning (DFL) has emerged as an attractive paradigm to facilitate data collaboration while being amenable to privacy-preserving data and knowledge sharing, cost reduction, and prediction accuracy improvement. Unfortunately, the participating parties in DFL tend to be heterogeneous with skew datasets and uneven capabilities. Inevitably, training and transmission costs, and the presence of free-riders pose challenges to the adoption and participation of DFL. The absence of centralized parameter servers further exacerbates the problem of evaluating the contribution of each individual party. Therefore, an effective incentive mechanism is essential to promote data collaboration. In this paper, we propose a novel Incentive-aware Decentralized fEderated leArning (IDEA) framework for facilitating data collaboration. Specifically, we first design a customizable reward scheme for heterogeneous parties to optimize their respective objectives such as higher model accuracy, communication efficiency, and computational efficiency. To reward fairly to deserving parties while offering flexibility, we propose a novel multi-agent reinforcement learning (MARL) incentive mechanism, which enables heterogeneous parties to learn their own optimal collaboration policy. We then design an efficient decentralized data collaboration algorithm that supports the customizable reward scheme based on individual objective-specific collaboration policy. We theoretically prove that the algorithm achieves a Nash equilibrium, which ensures the fairness of the corresponding rewards for parties. We conduct extensive experiments to evaluate the performance of our proposed framework against four baselines on five real-world datasets. The results show that IDEA outperforms state-of-the-art methods in terms of effectiveness, efficiency, and accumulated reward.

Incentivizing Honesty among Competitors in Collaborative Learning and Optimization

Incentivizing Truthful Collaboration in Heterogeneous Federated Learning

MotiLearn: Contract-Based Incentive Mechanism for Heterogeneous Edge Collaborative Training

Incentives in Private Collaborative Machine Learning

Self-Interested Agents in Collaborative Learning: An Incentivized Adaptive Data-Centric Framework

Collaboration in Participant-Centric Federated Learning: A Game-Theoretical Perspective

Incentivized Collaboration in Active Learning

Efficient Core-selecting Incentive Mechanism for Data Sharing in Federated Learning

Incentive-Aware Decentralized Data Collaboration.

A Cooperative Analysis to Incentivize Communication-Efficient Federated Learning

Defection-Free Collaboration between Competitors in a Learning System

Unravelling in Collaborative Learning

Incentivising cooperation by rewarding the weakest member

One for One, or All for All: Equilibria and Optimality of Collaboration in Federated Learning

Learning to Incentivize Other Learning Agents

Fair yet Asymptotically Equal Collaborative Learning

An Incentive Compatible ZD Strategy-Based Data Sharing Model for Federated Learning: A Perspective of Iterated Prisoner's Dilemma

Similarity-based cooperative equilibrium

How to Incentivize Data-Driven Collaboration Among Competing Parties

Incentive Compatible Active Learning

Truthful Incentive Mechanism Design via Internalizing Externalities and LP Relaxation for Vertical Federated Learning