Abstract:As an effective technique to relieve the problem of resource constraints on mobile devices (MDs), the computation offloading utilizes powerful cloud and edge resources to process the computation-intensive tasks of mobile applications uploaded from MDs. In cloud-edge computing, the resources (e.g., cloud and edge servers) that can be accessed by mobile applications may change dynamically. Meanwhile, the parallel tasks in mobile applications may lead to the huge solution space of offloading decisions. Therefore, it is challenging to determine proper offloading plans in response to such high dynamics and complexity in cloud-edge environments. The existing studies often preset the priority of parallel tasks to simplify the solution space of offloading decisions, and thus the proper offloading plans cannot be found in many cases. To address this challenge, we propose a novel real-time and Dependency-aware task Offloading method with Deep Q-networks (DODQ) in cloud-edge computing. In DODQ, mobile applications are first modeled as Directed Acyclic Graphs (DAGs). Next, the Deep Q-Networks (DQN) is customized to train the decision-making model of task offloading, aiming to quickly complete the decision-making process and generate new offloading plans when the environments change, which considers the parallelism of tasks without presetting the task priority when scheduling tasks. Simulation results show that the DODQ can well adapt to different environments and efficiently make offloading decisions. Moreover, the DODQ outperforms the state-of-art methods and quickly reaches the optimal/near-optimal performance.

DGCQN: a RL and GCN combined method for DAG scheduling in edge computing

A DAG-Based XCIGS Algorithm for Dependent Tasks in Grid Environments.

Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning

Edge Computing Empowered Digital Twin: an End-to-End Computing Task Scheduling Approach

Graph Attention Network Reinforcement Learning Based Computation Offloading in Multi-Access Edge Computing.

Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Online-learning task scheduling with GNN-RL scheduler in collaborative edge computing

Reinforcement Learning Based Online Scheduling of Multiple Workflows in Edge Environment

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Multi-Component Job Scheduling in Edge Computing

Reliability-Constrained Task Scheduling for DAG Applications in Mobile Edge Computing

A scheduling algorithm for heterogeneous computing systems by edge cover queue

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Learning to Schedule DAG Tasks

Cost-Effective Task Offloading Scheduling for Hybrid Mobile Edge-Quantum Computing

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Scheduling