Abstract:Recently, computation offloading methods have greatly improved the Quality of Experience (QoE) in Multi-access Edge Computing (MEC) by offloading tasks to the edge servers. Since well-coordinated actions of Terminal Devices (TDs) are critical to improving the performance of the entire individual system, many practical MEC-based applications, i.e., firefighting robots and unmanned aerial vehicles, require great teamwork among TDs. However, real-world scenarios are usually bound by resource conditions. For instance, network connectivity may weaken or experience interruptions during emergency situations. In cases where the communication medium is utilized by multiple TDs, achieving effective coordination poses a significant challenge. In this paper, we propose a computation offloading scheme based on Scheduled Multi-agent Deep Reinforcement Learning (SMDRL) to make the most efficient decision in a resource-constrained scenario. First, we design a virtual energy queue based on the MEC system and maximize the QoE (related to service delay and energy consumption) in a real-time manner. Subsequently, we propose a scheduled multi-agent deep reinforcement learning algorithm to support each TD in learning how to encode messages, select actions, and schedule itself based on the received messages. Furthermore, a TopK mechanism is introduced. This mechanism chooses the most crucial TDs to broadcast their messages, and then the computation offloading problem in a communication-constrained MEC environment can be solved in a low-communication manner. Also, we prove that even under limited communication conditions, our proposed methods can still lead to the close-to-optimal performance. The final performance analysis shows that the developed scheme has significant advantages over other representative schemes.

$Q_{C}-DQN$: A Novel Constrained Reinforcement Learning Method for Computation Offloading in Multi-access Edge Computing.

DQN-Based Collaborative Computation Offloading for Edge Load Balancing

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Computation Offloading in Resource-Constrained Multi-Access Edge Computing

Multi-objective Deep Reinforcement Learning for Computation offloading in UAV-Assisted Multi-Access Edge Computing

Task Offloading Algorithm in Edge Computing Based on DQN

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Computation Offloading and Resource Allocation in Unmanned Aerial Vehicle Networks.

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

Cloud-Edge Collaborative Computation Offloading: A Deep Reinforcement Learning approach

Q-learning based computation offloading for multi-UAV-enabled cloud-edge computing networks

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

DQN-based mobile edge computing for smart Internet of vehicle

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach