Abstract:To handle the ever-increasing IoT devices with computation-intensive and delay-critical applications, it is imperative to leverage the collaborative potential of edge and cloud computing. In this paper, we investigate the dynamic offloading of packets with finite block length (FBL) in an edge-cloud collaboration system consisting of multi-mobile IoT devices (MIDs) with energy harvesting (EH), multi-edge servers, and one cloud server (CS) in a dynamic environment. The optimization problem is formulated to minimize the average long-term service cost defined as the weighted sum of MID energy consumption and service delay, with the constraints of the available resource, the energy causality, the allowable service delay, and the maximum decoding error probability. To address the problem involving both discrete and continuous variables, we propose a multi-device hybrid decision-based deep reinforcement learning (DRL) solution, named DDPG-D3QN algorithm, where the deep deterministic policy gradient (DDPG) and dueling double deep Q networks (D3QN) are invoked to tackle continuous and discrete action domains, respectively. Specifically, we improve the actor-critic structure of DDPG by combining D3QN. It utilizes the actor part of DDPG to search for the optimal offloading rate and power control of local execution. Meanwhile, it combines the critic part of DDPG with D3QN to select the optimal server for offloading. Simulation results demonstrate the proposed DDPG-D3QN algorithm has better stability and faster convergence, while achieving higher rewards than the existing DRL-based methods. Furthermore, the edge-cloud collaboration approach outperforms non-collaborative schemes.

DDPG-based optimal task placement strategy for computation offloading in green mobile edge networks

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

A Task Offloading Decision and Resource Allocation Algorithm Based on DDPG in Mobile Edge Computing

An Optimized Greedy-Based Task Offloading Method for Mobile Edge Computing

Green Parallel Online Offloading for DSCI-Type Tasks in IoT-Edge Systems

Energy-efficient and Latency-optimal Task Offloading Strategies for Multi-user in Edge Computing

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Deep Deterministic Policy Gradient Based Computation Offloading in Wireless-Powered MEC Networks.

DDPG-based Computation Offloading and Service Caching in Mobile Edge Computing

Energy-Efficient Computation Offloading for Mobile Edge Networks - A Graph Theory Approach.

Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network.

Dynamic Task Offloading in MEC-Enabled IoT Networks - A Hybrid DDPG-D3QN Approach.

A Latency-Optimal Task Offloading Scheme Using Genetic Algorithm for DAG Applications in Edge Computing

User-Centric Computation Offloading for Edge Computing

Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach

Latency-Optimized Multi-User Task Offloading Scheme Using Dynamic Priority and Duplication in Edge Computing

Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning

Iterative Dynamic Critical Path Scheduling: an Efficient Technique for Offloading Task Graphs in Mobile Edge Computing

Edge Computing Based Computation Offloading

Mobility-Aware Efficient Task Offloading with Dependency Guarantee in Mobile Edge Computing Networks

Lyapunov-Assisted Decentralized Dynamic Offloading Strategy Based on Deep Reinforcement Learning