Abstract:With the development of IoT and 5G technologies, multi-access edge computing has been widely concerned due to the advantage of providing extra computation resource in edge servers for end-devices to complete their computation tasks with low latency and great reliability. Although considerable efforts on tasks offloading have been developed to reduce the energy consumption and computation latency, most of these efforts focused on independent tasks offloading in which the tasks ofÂ end-devices that are offloaded to edge servers are mutually independent, and offloading dependent tasks in which the execution of these tasks has strict dependencies is still a challenge and need to be further investigated. To this end, this paper considers the multi-access edge computing with channel interference and proposes a deep reinforcement learning based dependent task offloading scheme, namely DRL-DTO, to effectively offload dependent tasks of end-devices to edge servers for tasks computation with low energy consumption and low latency. Particularly, the directed acyclic graph (DAG) is introduced in our scheme to conduct the dependency model of dependent tasks, and a dependent task offloading model is developed with considering multiple constraints of task dependency, communication channel quality, computation latency and energy consumption. Based on the DAG model and dependent task offloading model, a priority queue for tasks of various end-devices is conducted and the dependent task offloading is transferred as a markov decision process (MDP). Then, a deep reinforcement learning based task offloading approach is proposed to solve the MDP of dependent task offloading and determine the effective offloading decision with objective of minimizing both the energy consumption of end-devices and computation latency of offloaded dependent tasks. Through performance evaluations, our results demonstrate that, in various scenarios including various property of edge-servers, various number of dependent tasks and various DAG dependency of dependent tasks, various preference factor, our DRL-DTO scheme can always achieve lower computation latency and energy consumption than existing schemes.

Federated Deep Reinforcement Learning-enabled Task Offloading in Cloud-Edge-Terminal Collaborative Networks

Dependency-aware task offloading based on deep reinforcement learning in mobile edge computing networks

Federated Deep Reinforcement Learning for Task Offloading in MEC-enabled Heterogeneous Networks

Federated Deep Reinforcement Learning for Task Offloading in Digital Twin Edge Networks

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

Hybrid Deep Reinforcement Learning-Based Task Offloading for D2D-Assisted Cloud-Edge-Device Collaborative Networks

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Federated Deep Reinforcement Learning for Online Task Offloading and Resource Allocation in WPC-MEC Networks

Deep Reinforcement Learning-Based Joint Task Offloading in Cloud-Edge-End Cooperation Environments

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

A Novel Deep Reinforcement Learning Based Dependent Tasks Offloading in Multi-Access Edge Computing

"DRL + FL": an Intelligent Resource Allocation Model Based on Deep Reinforcement Learning for Mobile Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Task offloading mechanism based on federated reinforcement learning in mobile edge computing

A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload

Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Online Computation Offloading with Double Reinforcement Learning Algorithm in Mobile Edge Computing

DRL-Based Service Function Chain Edge-to-Edge and Edge-to-Cloud Joint Offloading in Edge-Cloud Network

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Backscatter-Aided Hybrid Data Offloading for Mobile Edge Computing via Deep Reinforcement Learning