Abstract:Recently, computation offloading methods have greatly improved the Quality of Experience (QoE) in Multi-access Edge Computing (MEC) by offloading tasks to the edge servers. Since well-coordinated actions of Terminal Devices (TDs) are critical to improving the performance of the entire individual system, many practical MEC-based applications, i.e., firefighting robots and unmanned aerial vehicles, require great teamwork among TDs. However, real-world scenarios are usually bound by resource conditions. For instance, network connectivity may weaken or experience interruptions during emergency situations. In cases where the communication medium is utilized by multiple TDs, achieving effective coordination poses a significant challenge. In this paper, we propose a computation offloading scheme based on Scheduled Multi-agent Deep Reinforcement Learning (SMDRL) to make the most efficient decision in a resource-constrained scenario. First, we design a virtual energy queue based on the MEC system and maximize the QoE (related to service delay and energy consumption) in a real-time manner. Subsequently, we propose a scheduled multi-agent deep reinforcement learning algorithm to support each TD in learning how to encode messages, select actions, and schedule itself based on the received messages. Furthermore, a TopK mechanism is introduced. This mechanism chooses the most crucial TDs to broadcast their messages, and then the computation offloading problem in a communication-constrained MEC environment can be solved in a low-communication manner. Also, we prove that even under limited communication conditions, our proposed methods can still lead to the close-to-optimal performance. The final performance analysis shows that the developed scheme has significant advantages over other representative schemes.

Experience-based Computation Offloading by Deep Reinforcement Learning for Multi-access Edge Computing Network.

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

A Multi-agent Reinforcement Learning Based Offloading Strategy for Multi-access Edge Computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Task Graph offloading via Deep Reinforcement Learning in Mobile Edge Computing

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Computation Offloading in Resource-Constrained Multi-Access Edge Computing

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning

Multi-user Computation Offloading for Mobile Edge Computing: A Deep Reinforcement Learning and Game Theory Approach

A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Dynamic Edge Computation Offloading for Internet of Things with Energy Harvesting: A Learning Method.

Joint Computation Offloading and Service Caching in Mobile Edge-Cloud Computing Via Deep Reinforcement Learning