Abstract:As an effective technique to relieve the problem of resource constraints on mobile devices (MDs), the computation offloading utilizes powerful cloud and edge resources to process the computation-intensive tasks of mobile applications uploaded from MDs. In cloud-edge computing, the resources (e.g., cloud and edge servers) that can be accessed by mobile applications may change dynamically. Meanwhile, the parallel tasks in mobile applications may lead to the huge solution space of offloading decisions. Therefore, it is challenging to determine proper offloading plans in response to such high dynamics and complexity in cloud-edge environments. The existing studies often preset the priority of parallel tasks to simplify the solution space of offloading decisions, and thus the proper offloading plans cannot be found in many cases. To address this challenge, we propose a novel real-time and Dependency-aware task Offloading method with Deep Q-networks (DODQ) in cloud-edge computing. In DODQ, mobile applications are first modeled as Directed Acyclic Graphs (DAGs). Next, the Deep Q-Networks (DQN) is customized to train the decision-making model of task offloading, aiming to quickly complete the decision-making process and generate new offloading plans when the environments change, which considers the parallelism of tasks without presetting the task priority when scheduling tasks. Simulation results show that the DODQ can well adapt to different environments and efficiently make offloading decisions. Moreover, the DODQ outperforms the state-of-art methods and quickly reaches the optimal/near-optimal performance.

Dynamic Task Offloading in Edge Computing based on Dependency-aware Reinforcement Learning

Adaptive Task Offloading in Coded Edge Computing: A Deep Reinforcement Learning Approach

Dynamic Task Offloading for Internet of Things in Mobile Edge Computing Via Deep Reinforcement Learning

Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

Dependent Task-Offloading Strategy Based on Deep Reinforcement Learning in Mobile Edge Computing

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning

Task Graph offloading via Deep Reinforcement Learning in Mobile Edge Computing

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Edge Collaborative Online Task Offloading Method Based on Reinforcement Learning

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Pruning-based Deep Reinforcement Learning for Task Offloading in End-Edge-Cloud Collaborative Mobile Edge Computing

Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach

Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

Collaborative Optimization Strategy for Dependent Task Offloading in Vehicular Edge Computing

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT