Abstract:Computation offloading decisions play a crucial role in implementing mobile-edge computing (MEC) technology in the Internet of Things (IoT) services. Mobile network operators (MNOs) can employ computation offloading techniques to reduce task completion delay and improve the Quality of Service (QoS) for users by optimizing the system’s processing delay and energy consumption. However, different IoT applications (e.g., entertainment and autonomous driving) generate different delay tolerances and benefits for computational tasks from the MNO perspective. Therefore, simply minimizing the delay of all tasks does not satisfy the QoS of each user. The system architecture design should consider the significance of users and the heterogeneity of tasks. Unfortunately, rare work has been done to discuss this practical issue. In this article, from the perspective of MNO, we investigate the computation offloading optimization problem of multiuser delay-sensitive tasks. First, we propose a new optimization model, which designs different optimization objectives for the cost and revenue of tasks. Then, we transform the problem into a Markov decision processes problem, which leads to designing a multiagent iterative optimization framework. For the strategic optimization of each agent, we further propose a cooperative multiagent deep reinforcement learning (CMDRL) algorithm to optimize two different objectives at the same time. Two agents are integrated into the CMDRL framework to enable agents to collaborate and converge to the global optimum in a distributed manner. At the same time, the priority experience replay method is introduced to improve the utilization rate of effective samples and the learning efficiency of the algorithm. The experimental results show that our proposed method can effectively achieve a significantly higher profit than the alternative state-of-the-art method and exhibit a more favorable computational performance than benchmark deep reinforcement learning methods.

Multi-Agent Reinforcement Learning for Cooperative Task Offloading in Internet-of-Vehicles

Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT

Multi-Agent Deep Reinforcement Learning Based Collaborative Computation Offloading in Vehicular Edge Networks

Multi-agent Reinforcement Learning for Vehicular Task Offloading with Multi-Step Trajectory Prediction

Knowledge-Driven Multi-Agent Reinforcement Learning for Computation Offloading in Cybertwin-Enabled Internet of Vehicles

Joint Optimization for MEC Computation Offloading and Resource Allocation in IoV Based on Deep Reinforcement Learning

Value-based Multi-Agent Deep Reinforcement Learning for Collaborative Computation Offloading in Internet of Things Networks

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Multi-Agent DRL-Based Task Offloading in Multiple RIS-Aided IoV Networks

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning

Optimization of Edge Cloud Collaborative Computing Resource Management for Internet of Vehicles Based on Multi-Agent Deep Reinforcement Learning

Cooperative Multiagent Deep Reinforcement Learning for Computation Offloading: A Mobile Network Operator Perspective

Distance-aware Multi-Agent Reinforcement Learning for Task Offloading in MEC Network.

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks.

Collaborative Optimization Strategy for Dependent Task Offloading in Vehicular Edge Computing

Intelligent Computation Offloading for MEC-Based Cooperative Vehicle Infrastructure System: A Deep Reinforcement Learning Approach

Mean-field reinforcement learning for decentralized task offloading in vehicular edge computing

Vehicle-Road Cooperative Task Offloading with Task Migration in MEC-Enabled IoV

Multi-Agent Reinforcement Learning Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network

DRL-based Task and Computational Offloading for Internet of Vehicles in Decentralized Computing