Efficient Core-selecting Incentive Mechanism for Data Sharing in Federated Learning

Mengda Ji,Genjiu Xu,Jianjun Ge,Mingqiang Li

2023-09-26

Abstract:Federated learning is a distributed machine learning system that uses participants' data to train an improved global model. In federated learning, participants cooperatively train a global model, and they will receive the global model and payments. Rational participants try to maximize their individual utility, and they will not input their high-quality data truthfully unless they are provided with satisfactory payments based on their data quality. Furthermore, federated learning benefits from the cooperative contributions of participants. Accordingly, how to establish an incentive mechanism that both incentivizes inputting data truthfully and promotes stable cooperation has become an important issue to consider. In this paper, we introduce a data sharing game model for federated learning and employ game-theoretic approaches to design a core-selecting incentive mechanism by utilizing a popular concept in cooperative games, the core. In federated learning, the core can be empty, resulting in the core-selecting mechanism becoming infeasible. To address this, our core-selecting mechanism employs a relaxation method and simultaneously minimizes the benefits of inputting false data for all participants. However, this mechanism is computationally expensive because it requires aggregating exponential models for all possible coalitions, which is infeasible in federated learning. To address this, we propose an efficient core-selecting mechanism based on sampling approximation that only aggregates models on sampled coalitions to approximate the exact result. Extensive experiments verify that the efficient core-selecting mechanism can incentivize inputting high-quality data and stable cooperation, while it reduces computational overhead compared to the core-selecting mechanism.

Computer Science and Game Theory,Machine Learning

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address the issue of incentive mechanisms in federated learning, specifically:

1. **Data Sharing and Authenticity**: In federated learning, participants need to share their high-quality data to train the global model. However, participants will only input their high-quality data truthfully if they receive satisfactory rewards. Therefore, designing an incentive mechanism to encourage participants to input data truthfully is a key issue.

2. **Cooperation Stability**: Federated learning relies on the stable cooperation of participants. If the incentive mechanism cannot ensure stable cooperation among participants, the performance of the entire system will be affected. Therefore, establishing an incentive mechanism that can both encourage truthful data input and promote stable cooperation is crucial.

3. **Application of Core Selection Mechanism**: The paper proposes a core selection incentive mechanism based on the game theory core concept. Since the core may be empty in some cases, the paper adopts a relaxed version of the core (strong ϵ-core) to address this issue and minimize the benefits of inputting false data.

4. **Computational Efficiency**: Traditional core selection mechanisms have high computational complexity in federated learning, making them difficult to apply in practice. Therefore, the paper proposes an efficient core selection mechanism based on sampling approximation, significantly reducing computational complexity.

Through the above research, the paper aims to design an incentive mechanism that can encourage participants to input high-quality data truthfully, promote stable cooperation, and have high computational efficiency.