Abstract:Data collaboration enables multiple parties to pool data for deriving meaningful data insights. However, data misuse and unlawful data collection have led to precautionary measures being imposed by individual organizations to guide against data leakage and abuse. As a response, decentralized federated learning (DFL) has emerged as an attractive paradigm to facilitate data collaboration while being amenable to privacy-preserving data and knowledge sharing, cost reduction, and prediction accuracy improvement. Unfortunately, the participating parties in DFL tend to be heterogeneous with skew datasets and uneven capabilities. Inevitably, training and transmission costs, and the presence of free-riders pose challenges to the adoption and participation of DFL. The absence of centralized parameter servers further exacerbates the problem of evaluating the contribution of each individual party. Therefore, an effective incentive mechanism is essential to promote data collaboration. In this paper, we propose a novel Incentive-aware Decentralized fEderated leArning (IDEA) framework for facilitating data collaboration. Specifically, we first design a customizable reward scheme for heterogeneous parties to optimize their respective objectives such as higher model accuracy, communication efficiency, and computational efficiency. To reward fairly to deserving parties while offering flexibility, we propose a novel multi-agent reinforcement learning (MARL) incentive mechanism, which enables heterogeneous parties to learn their own optimal collaboration policy. We then design an efficient decentralized data collaboration algorithm that supports the customizable reward scheme based on individual objective-specific collaboration policy. We theoretically prove that the algorithm achieves a Nash equilibrium, which ensures the fairness of the corresponding rewards for parties. We conduct extensive experiments to evaluate the performance of our proposed framework against four baselines on five real-world datasets. The results show that IDEA outperforms state-of-the-art methods in terms of effectiveness, efficiency, and accumulated reward.

Scalable Data Point Valuation in Decentralized Learning

DDS: an Auction Based on a Variant of Data Shapley for Federated Learning.

Evaluate the Contribution of Multiple Participants in Federated Learning

A Federated Learning Framework Via Decentralized Data Valuation for Chronic Disease Healthcare

A Principled Approach to Data Valuation for Federated Learning

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach

Improving Fairness for Data Valuation in Horizontal Federated Learning

DPVS-Shapley:Faster and Universal Contribution Evaluation Component in Federated Learning

Data Valuation for Vertical Federated Learning: A Model-free and Privacy-preserving Method

DistDD: Distributed Data Distillation Aggregation through Gradient Matching

Data Valuation and Detections in Federated Learning

Incentive-Aware Decentralized Data Collaboration.

Quantifying Bytes: Understanding Practical Value of Data Assets in Federated Learning

Fair and efficient contribution valuation for vertical federated learning

Communication-Efficient Learning of Deep Networks from Decentralized Data

Towards blockchain-enabled decentralized and secure federated learning

Towards Data Valuation via Asymmetric Data Shapley

Demystifying Swarm Learning: an Emerging Decentralized Federated Learning System

LAVA: Data Valuation without Pre-Specified Learning Algorithms

Decentralized Federated Learning: Balancing Communication and Computing Costs