Abstract:The development of mobile services has impacted a variety of computation-intensive and time-sensitive applications, such as recommendation systems and daily payment methods. However, computing task competition involving limited resources increases the task processing latency and energy consumption of mobile devices, as well as time constraints. Mobile edge computing (MEC) has been widely used to address these problems. However, there are limitations to existing methods used during computation offloading. On the one hand, they focus on independent tasks rather than dependent tasks. The challenges of task dependency in the real world, especially task segmentation and integration, remain to be addressed. On the other hand, the multiuser scenarios related to resource allocation and the mutex access problem must be considered. In this paper, we propose a novel offloading approach, Com-DDPG, for MEC using multiagent reinforcement learning to enhance the offloading performance. First, we discuss the task dependency model, task priority model, energy consumption model, and average latency from the perspective of server clusters and multidependence on mobile tasks. Our method based on these models is introduced to formalize communication behavior among multiple agents; then, reinforcement learning is executed as an offloading strategy to obtain the results. Because of the incomplete state information, long short-term memory (LSTM) is employed as a decision-making tool to assess the internal state. Moreover, to optimize and support effective action, we consider using a bidirectional recurrent neural network (BRNN) to learn and enhance features obtained from agents' communication. Finally, we simulate experiments on the Alibaba cluster dataset. The results show that our method is better than other baselines in terms of energy consumption, load status and latency.

A TP-DDPG Algorithm Based on Cache Assistance for Task Offloading in Urban Rail Transit

Task Caching, Offloading and Resource Allocation in D2D-Aided Fog Computing Networks

Dynamic Resource Allocation for Multi-Access Edge Computing in Urban Rail Transit

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Computation Pre-Offloading for MEC-Enabled Vehicular Networks via Trajectory Prediction

Computing Offloading Based on TD3 Algorithm in Cache-Assisted Vehicular NOMA-MEC Networks

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning

Improved DDPG Based Two-Timescale Multi-Dimensional Resource Allocation for Multi-Access Edge Computing Networks

Dynamic Task Offloading in MEC-Enabled IoT Networks - A Hybrid DDPG-D3QN Approach.

Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers

Data and Model Driven Task Offloading Strategy in the Dynamic Mobile Edge Computing System

Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

Potential Game Based Task Offloading in the High-Speed Railway With Reinforcement Learning

Parallel Offloading and Resource Optimization for Multi-Hop Ad Hoc Network-Enabled CBTC With Mobile Edge Computing

Com-DDPG: A Multiagent Reinforcement Learning-based Offloading Strategy for Mobile Edge Computing

DDPG-based Computation Offloading and Service Caching in Mobile Edge Computing

QoS-aware task offloading and resource allocation optimization in vehicular edge computing networks via MADDPG

DDQN-based Online Computation Offloading and Application Caching for Dynamic Edge Computing Service Management

TBTOA: A DAG-Based Task Offloading Scheme for Mobile Edge Computing

TPD: Temporal and Positional Computation Offloading with Dynamic and Dependent Tasks

DRL-Based Hybrid Task Offloading and Resource Allocation in Vehicular Networks