Abstract:With the development of IoT and 5G technologies, multi-access edge computing has been widely concerned due to the advantage of providing extra computation resource in edge servers for end-devices to complete their computation tasks with low latency and great reliability. Although considerable efforts on tasks offloading have been developed to reduce the energy consumption and computation latency, most of these efforts focused on independent tasks offloading in which the tasks ofÂ end-devices that are offloaded to edge servers are mutually independent, and offloading dependent tasks in which the execution of these tasks has strict dependencies is still a challenge and need to be further investigated. To this end, this paper considers the multi-access edge computing with channel interference and proposes a deep reinforcement learning based dependent task offloading scheme, namely DRL-DTO, to effectively offload dependent tasks of end-devices to edge servers for tasks computation with low energy consumption and low latency. Particularly, the directed acyclic graph (DAG) is introduced in our scheme to conduct the dependency model of dependent tasks, and a dependent task offloading model is developed with considering multiple constraints of task dependency, communication channel quality, computation latency and energy consumption. Based on the DAG model and dependent task offloading model, a priority queue for tasks of various end-devices is conducted and the dependent task offloading is transferred as a markov decision process (MDP). Then, a deep reinforcement learning based task offloading approach is proposed to solve the MDP of dependent task offloading and determine the effective offloading decision with objective of minimizing both the energy consumption of end-devices and computation latency of offloaded dependent tasks. Through performance evaluations, our results demonstrate that, in various scenarios including various property of edge-servers, various number of dependent tasks and various DAG dependency of dependent tasks, various preference factor, our DRL-DTO scheme can always achieve lower computation latency and energy consumption than existing schemes.

Task Offloading Via Prioritized Experience-based Double Dueling DQN in Edge-assisted IIoT

Task Offloading and Resource Allocation for Industrial Internet of Things: A Double-Dueling Deep Q-Network Approach

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Dynamic Task Offloading in MEC-Enabled IoT Networks - A Hybrid DDPG-D3QN Approach.

Enhanced DQN in Task Offloading Across Multi-Tier Computing Networks

Intelligent Delay-Aware Partial Computing Task Offloading for Multiuser Industrial Internet of Things Through Edge Computing

QoE-Based Task Offloading With Deep Reinforcement Learning in Edge-Enabled Internet of Vehicles

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing

Multi-agent DRL for Edge Computing: A Real-Time Proportional Compute Offloading

Dynamic Task Offloading for Internet of Things in Mobile Edge Computing Via Deep Reinforcement Learning

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Multi-Objective DAG Task Offloading in MEC Environment Based on Federated DQN with Automated Hyperparameter Optimization

An Advanced Deep Reinforcement Learning Algorithm for Three-layer D2D-Edge-Cloud Computing Architecture for Efficient Task Offloading in Internet of Things

$Q_{C}-DQN$: A Novel Constrained Reinforcement Learning Method for Computation Offloading in Multi-access Edge Computing.

Deep Reinforcement Learning Method for Task Offloading in Mobile Edge Computing Networks Based on Parallel Exploration with Asynchronous Training

A Novel Deep Reinforcement Learning Based Dependent Tasks Offloading in Multi-Access Edge Computing

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Task Offloading Algorithm in Edge Computing Based on DQN

DMRO: A Deep Meta Reinforcement Learning-Based Task Offloading Framework for Edge-Cloud Computing

Deep Reinforcement Learning-Based Dynamical Task Offloading for Mobile Edge Computing