Abstract:With the development of IoT and 5G technologies, multi-access edge computing has been widely concerned due to the advantage of providing extra computation resource in edge servers for end-devices to complete their computation tasks with low latency and great reliability. Although considerable efforts on tasks offloading have been developed to reduce the energy consumption and computation latency, most of these efforts focused on independent tasks offloading in which the tasks ofÂ end-devices that are offloaded to edge servers are mutually independent, and offloading dependent tasks in which the execution of these tasks has strict dependencies is still a challenge and need to be further investigated. To this end, this paper considers the multi-access edge computing with channel interference and proposes a deep reinforcement learning based dependent task offloading scheme, namely DRL-DTO, to effectively offload dependent tasks of end-devices to edge servers for tasks computation with low energy consumption and low latency. Particularly, the directed acyclic graph (DAG) is introduced in our scheme to conduct the dependency model of dependent tasks, and a dependent task offloading model is developed with considering multiple constraints of task dependency, communication channel quality, computation latency and energy consumption. Based on the DAG model and dependent task offloading model, a priority queue for tasks of various end-devices is conducted and the dependent task offloading is transferred as a markov decision process (MDP). Then, a deep reinforcement learning based task offloading approach is proposed to solve the MDP of dependent task offloading and determine the effective offloading decision with objective of minimizing both the energy consumption of end-devices and computation latency of offloaded dependent tasks. Through performance evaluations, our results demonstrate that, in various scenarios including various property of edge-servers, various number of dependent tasks and various DAG dependency of dependent tasks, various preference factor, our DRL-DTO scheme can always achieve lower computation latency and energy consumption than existing schemes.

A Reinforcement Learning-based DAG Tasks Scheduling in Edge-Cloud Collaboration Systems

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

DGCQN: a RL and GCN combined method for DAG scheduling in edge computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Digital Twin-Driven Collaborative Scheduling for Heterogeneous Task and Edge-End Resource Via Multi-Agent Deep Reinforcement Learning.

Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning

Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Scheduling

Improved Double Deep Q Network-Based Task Scheduling Algorithm in Edge Computing for Makespan Optimization

Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Telemetry-aided cooperative multi-agent online reinforcement learning for DAG task scheduling in computing power networks

Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

Task Graph offloading via Deep Reinforcement Learning in Mobile Edge Computing

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

A Novel Deep Reinforcement Learning Based Dependent Tasks Offloading in Multi-Access Edge Computing

Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System