Abstract:Recently, computation offloading methods have greatly improved the Quality of Experience (QoE) in Multi-access Edge Computing (MEC) by offloading tasks to the edge servers. Since well-coordinated actions of Terminal Devices (TDs) are critical to improving the performance of the entire individual system, many practical MEC-based applications, i.e., firefighting robots and unmanned aerial vehicles, require great teamwork among TDs. However, real-world scenarios are usually bound by resource conditions. For instance, network connectivity may weaken or experience interruptions during emergency situations. In cases where the communication medium is utilized by multiple TDs, achieving effective coordination poses a significant challenge. In this paper, we propose a computation offloading scheme based on Scheduled Multi-agent Deep Reinforcement Learning (SMDRL) to make the most efficient decision in a resource-constrained scenario. First, we design a virtual energy queue based on the MEC system and maximize the QoE (related to service delay and energy consumption) in a real-time manner. Subsequently, we propose a scheduled multi-agent deep reinforcement learning algorithm to support each TD in learning how to encode messages, select actions, and schedule itself based on the received messages. Furthermore, a TopK mechanism is introduced. This mechanism chooses the most crucial TDs to broadcast their messages, and then the computation offloading problem in a communication-constrained MEC environment can be solved in a low-communication manner. Also, we prove that even under limited communication conditions, our proposed methods can still lead to the close-to-optimal performance. The final performance analysis shows that the developed scheme has significant advantages over other representative schemes.

Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning

Joint Data Offloading and Resource Allocation for Multi-Cloud Heterogeneous Mobile Edge Computing Using Multi-Agent Reinforcement Learning

A Multi-agent Reinforcement Learning Based Offloading Strategy for Multi-access Edge Computing

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

Multi-Layer Computation Offloading in Distributed Heterogeneous Mobile Edge Computing Networks

When Multi-access Edge Computing Meets Multi-area Intelligent Reflecting Surface: A Multi-agent Reinforcement Learning Approach

Distributed Task Offloading Based on Multi-Agent Deep Reinforcement Learning.

Cooperative Task Offloading for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Based Distributed Transmission in Collaborative Cloud-Edge Systems.

Policy network-based dual-agent deep reinforcement learning for multi-resource task offloading in multi-access edge cloud networks

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning Offloading Algorithm Based on Resource Reservation and Task Adjustment

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems Via Multi-Agent Deep Reinforcement Learning

Multi-Agent Reinforcement Learning For Joint Wireless And Computational Resource Allocation In Mobile Edge Computing System

Distance-aware Multi-Agent Reinforcement Learning for Task Offloading in MEC Network.

Multiagent Deep Reinforcement Learning for Joint Multichannel Access and Task Offloading of Mobile-Edge Computing in Industry 4.0

Joint Task Assignment and Resource Allocation in the Heterogeneous Multi-Layer Mobile Edge Computing Networks

A Multi-Agent Deep Reinforcement Learning Approach for Computation Offloading in 5G Mobile Edge Computing

Computation Offloading in Resource-Constrained Multi-Access Edge Computing