Abstract:With the development of the IoT (Internet of Things), sensors networks can bring a large amount of valuable data. In addition to be utilized in the local IoT applications, the data can also be traded in the connected edge servers. As an efficient resource allocation mechanism, the double auction has been widely used in the stock and futures markets and can be also applied in the data resource allocation in sensor networks. Currently, there usually exist multiple edge servers running double auctions competing with each other to attract data users (buyers) and producers (sellers). Therefore, the double auction market run on each edge server needs efficient mechanism to improve the allocation efficiency. Specifically, the pricing strategy of the double auction plays an important role on affecting traders’ profit, and thus, will affect the traders’ market choices and bidding strategies, which in turn affect the competition result of double auction markets. In addition, the traders’ trading strategies will also affect the market’s pricing strategy. Therefore, we need to analyze the double auction markets’ pricing strategy and traders’ trading strategies. Specifically, we use a deep reinforcement learning algorithm combined with mean field theory to solve this problem with a huge state and action space. For trading strategies, we use the Independent Parametrized Deep Q-Network (I-PDQN) algorithm combined with mean field theory to compute the Nash equilibrium strategies. We then compare it with the fictitious play (FP) algorithm. The experimental results show that the computation speed of I-PDQN algorithm is significantly faster than that of FP algorithm. For pricing strategies, the double auction markets will dynamically adjust the pricing strategy according to traders’ trading strategies. This is a sequential decision-making process involving multiple agents. Therefore, we model it as a Markov game. We adopt Multiagent Deep Deterministic Policy Gradient (MADDPG) algorithm to analyze the Nash equilibrium pricing strategies. The experimental results show that the MADDPG algorithm solves the problem faster than the FP algorithm.

Reinforcement-Learning- and Belief-Learning-Based Double Auction Mechanism for Edge Computing Resource Allocation

Deep Reinforcement Learning-Based Pricing Strategy in Double-Auction Market for Edge Computing Resource Allocation

Multi-Participant Double Auction for Resource Allocation and Pricing in Edge Computing

Double Auction Mechanism for Resource Allocation in Satellite MEC

A Double Auction-Based Approach for Multi-User Resource Allocation in Mobile Edge Computing.

Resource allocation and network pricing based on double auction in mobile edge computing

Multi-Task Cross-Server Double Auction for Resource Allocation in Mobile Edge Computing.

Mobile Edge Computing Enabled Intelligent IoT

Trading and Pricing Sensor Data in Competing Edge Servers with Double Auction Markets

Resource Allocation Strategy Based on Improved Auction Algorithm in Mobile Edge Computing Environment

Double auction mechanisms in edge computing resource allocation for blockchain networks

Auction-Based Dependent Task Offloading for IoT Users in Edge Clouds

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Double Auction-Based Resource Allocation for Mobile Edge Computing in Industrial Internet of Things.

Multi-user Computation Offloading for Mobile Edge Computing: A Deep Reinforcement Learning and Game Theory Approach

An Envy-Free Auction Mechanism for Resource Allocation in Edge Computing Systems

Dual Resource Joint Auction Algorithm for 5G Multiple Access Edge Computing with System Utility Guarantee

A Repeated Auction Model for Load-Aware Dynamic Resource Allocation in Multi-Access Edge Computing

A Truthful Combinatorial Auction Mechanism towards Mobile Edge Computing in Industrial Internet of Things

A Novel Latency-Guaranteed Based Resource Double Auction for Market-Oriented Edge Computing.

A Truthful Auction Mechanism for Resource Allocation in Mobile Edge Computing