Abstract:Device-to-device (D2D) is a pivotal technology in the next generation of communication, allowing for direct task offloading between mobile devices (MDs) to improve the efficient utilization of idle resources. This paper proposes a novel algorithm for dynamic task offloading between the active MDs and the idle MDs in a D2D-MEC (mobile edge computing) system by deploying multi-agent deep reinforcement learning (DRL) to minimize the long-term average delay of delay-sensitive tasks under deadline constraints. Our core innovation is a dynamic partitioning scheme for idle and active devices in the D2D-MEC system, accounting for stochastic task arrivals and multi-time-slot task execution, which has been insufficiently explored in the existing literature. We adopt a queue-based system to formulate a dynamic task offloading optimization problem. To address the challenges of large action space and the coupling of actions across time slots, we model the problem as a Markov decision process (MDP) and perform multi-agent DRL through multi-agent proximal policy optimization (MAPPO). We employ a centralized training with decentralized execution (CTDE) framework to enable each MD to make offloading decisions solely based on its local system state. Extensive simulations demonstrate the efficiency and fast convergence of our algorithm. In comparison to the existing sub-optimal results deploying single-agent DRL, our algorithm reduces the average task completion delay by 11.0% and the ratio of dropped tasks by 17.0%. Our proposed algorithm is particularly pertinent to sensor networks, where mobile devices equipped with sensors generate a substantial volume of data that requires timely processing to ensure quality of experience (QoE) and meet the service-level agreements (SLAs) of delay-sensitive applications.

Dependency-aware task offloading based on deep reinforcement learning in mobile edge computing networks

Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach

Dynamic Task Offloading in Edge Computing based on Dependency-aware Reinforcement Learning

Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

Dependent Task-Offloading Strategy Based on Deep Reinforcement Learning in Mobile Edge Computing

Task graph offloading via deep reinforcement learning in mobile edge computing

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Adaptive Task Offloading in Coded Edge Computing: A Deep Reinforcement Learning Approach

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Pruning-based Deep Reinforcement Learning for Task Offloading in End-Edge-Cloud Collaborative Mobile Edge Computing

Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

Multi-Agent Deep Reinforcement Learning Based Dynamic Task Offloading in a Device-to-Device Mobile-Edge Computing Network to Minimize Average Task Delay with Deadline Constraints

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Energy-aware Task Offloading with Deadline Constraint in Mobile Edge Computing

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning