Abstract:Data collaboration enables multiple parties to pool data for deriving meaningful data insights. However, data misuse and unlawful data collection have led to precautionary measures being imposed by individual organizations to guide against data leakage and abuse. As a response, decentralized federated learning (DFL) has emerged as an attractive paradigm to facilitate data collaboration while being amenable to privacy-preserving data and knowledge sharing, cost reduction, and prediction accuracy improvement. Unfortunately, the participating parties in DFL tend to be heterogeneous with skew datasets and uneven capabilities. Inevitably, training and transmission costs, and the presence of free-riders pose challenges to the adoption and participation of DFL. The absence of centralized parameter servers further exacerbates the problem of evaluating the contribution of each individual party. Therefore, an effective incentive mechanism is essential to promote data collaboration. In this paper, we propose a novel Incentive-aware Decentralized fEderated leArning (IDEA) framework for facilitating data collaboration. Specifically, we first design a customizable reward scheme for heterogeneous parties to optimize their respective objectives such as higher model accuracy, communication efficiency, and computational efficiency. To reward fairly to deserving parties while offering flexibility, we propose a novel multi-agent reinforcement learning (MARL) incentive mechanism, which enables heterogeneous parties to learn their own optimal collaboration policy. We then design an efficient decentralized data collaboration algorithm that supports the customizable reward scheme based on individual objective-specific collaboration policy. We theoretically prove that the algorithm achieves a Nash equilibrium, which ensures the fairness of the corresponding rewards for parties. We conduct extensive experiments to evaluate the performance of our proposed framework against four baselines on five real-world datasets. The results show that IDEA outperforms state-of-the-art methods in terms of effectiveness, efficiency, and accumulated reward.

Mechanism for Decision-aware Collaborative Federated Learning: A Pitfall of Shapley Values

Evaluate the Contribution of Multiple Participants in Federated Learning

Federated Learning Incentive Mechanism Design via Shapley Value and Pareto Optimality

Federated Learning Incentive Mechanism Design via Enhanced Shapley Value Method

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

ShapleyFL: Robust Federated Learning Based on Shapley Value

Federated Learning Incentive Mechanism with Supervised Fuzzy Shapley Value

A Game-Theoretic Framework for Incentive Mechanism Design in Federated Learning

FedLaw: Value-Aware Federated Learning with Individual Fairness and Coalition Stability

Collaboration in Participant-Centric Federated Learning: A Game-Theoretical Perspective

Collaboration Equilibrium in Federated Learning

FairFed: Improving Fairness and Efficiency of Contribution Evaluation in Federated Learning via Cooperative Shapley Value

Mitigating federated learning contribution allocation instability through randomized aggregation

Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach

Efficient Core-selecting Incentive Mechanism for Data Sharing in Federated Learning

Preventing Strategic Behaviors in Collaborative Inference for Vertical Federated Learning

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning

Incentive-Aware Decentralized Data Collaboration.

Improving Fairness for Data Valuation in Horizontal Federated Learning

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

Towards Fair Graph Federated Learning via Incentive Mechanisms