Abstract:Computation offloading is a promising solution for resource-limited IoT devices to accomplish computation-intensive tasks. In order to promote the service trading between edge computing service providers and IoT devices, a series of works have explored incentive mechanisms for IoT-edge computing. However, most traditional incentive mechanisms (such as Stackelberg game-based approaches) expose privacy of participants. Moreover, the existing Reinforcement Learning (RL) based incentive mechanisms do not consider the competition among multiple providers, which is not in line with reality. In this paper, taking privacy concern and competition among providers into consideration, we utilize RL technique to design a privacy-preserving incentive mechanism for multiple providers and multiple IoT devices. Specifically, we model the pricing and demand problem of providers and IoT devices as a multi-leader multi-follower Stackelberg game, in which the providers work as leaders to determine their prices first, and then the IoT devices determine their demands as followers. We prove the existence and uniqueness of the Nash Equilibrium (NE) of this game. Due to privacy concern, providers and IoT devices are unwilling to disclose their own parameters, which makes the derivation of NE becoming a great challenge. To address this problem, a new RL-based Pricing Mechanism (RLPM) is proposed, which enables providers to learn their optimal pricing strategies without knowing private information of other participants. Finally, numerical simulations are conducted to illustrate the convergence and effectiveness of the RLPM compared with other existing algorithms.

An Incentive-Driven Edge Intelligence Based on Stackelberg Game

Economical Behavior Modeling and Analyses for Data Collection in Edge Internet of Things Networks

Federated learning for edge networks: Resource optimization and incentive mechanism

A Privacy-Preserving Incentive Mechanism for Federated Cloud-Edge Learning

Incentive Mechanism for Computation Offloading Using Edge Computing: A Stackelberg Game Approach.

A Learning-Based Incentive Mechanism for Federated Learning

Multi-Agent Deep Reinforcement Learning Based Incentive Mechanism for Multi-Task Federated Edge Learning

Incentive Mechanism Design for Federated Learning in Multi-access Edge Computing.

An Incentive Mechanism Design for Efficient Edge Learning by Deep Reinforcement Learning Approach

Incentive Framework for Cross-Device Federated Learning and Analytics with Multiple Tasks Based on a Multi-Leader-Follower Game

Incentive Mechanism Design for Federated Learning: A Two-stage Stackelberg Game Approach.

Incentive Mechanism Design for Federated Learning with Stackelberg Game Perspective in the Industrial Scenario

Privacy-preserving Incentive Mechanism for Multi-Leader Multi-Follower IoT-edge Computing Market: A Reinforcement Learning Approach

Incentive-Aware Partitioning and Offloading Scheme for Inference Services in Edge Computing

Incentive-boosted Federated Crowdsourcing

IncEFL: A Sharing Incentive Mechanism for Edge-Assisted Federated Learning in Industrial IoT

Incentive Mechanism Design for Resource Sharing in Collaborative Edge Learning

An ADMM-based Incentive Approach for Cooperative Data Analysis in Edge Computing.

Data-quality Aware Incentive Mechanism based on Stackelberg Game in Mobile Edge Computing

Multifactor Incentive Mechanism for Federated Learning in IoT: A Stackelberg Game Approach