Abstract:Mobile Edge Computing (MEC) has been regarded as a promising paradigm to reduce service latency for data processing in Internet of Things, by provisioning computing resources at network edge. In this work, we jointly optimize the task partitioning and computational power allocation for computation offloading in a dynamic environment with multiple IoT devices and multiple edge servers. We formulate the problem as a Markov decision process with constrained hybrid action space, which cannot be well handled by existing deep reinforcement learning (DRL) algorithms. Therefore, we develop a novel Deep Reinforcement Learning called Dirichlet Deep Deterministic Policy Gradient (D3PG), which is built on Deep Deterministic Policy Gradient (DDPG) to solve the problem. The developed model can learn to solve multi-objective optimization, including maximizing the number of tasks processed before expiration and minimizing the energy cost and service latency. More importantly, D3PG can effectively deal with constrained distribution-continuous hybrid action space, where the distribution variables are for the task partitioning and offloading, while the continuous variables are for computational frequency control. Moreover, the D3PG can address many similar issues in MEC and general reinforcement learning problems. Extensive simulation results show that the proposed D3PG outperforms the state-of-art methods. Mobile Edge Computing (MEC) has been regarded as a promising paradigm to reduce service latency for data processing in Internet of Things, by provisioning computing resources at network edge. In this work, we jointly optimize the task partitioning and computational power allocation for computation offloading in a dynamic environment with multiple IoT devices and multiple edge servers. We formulate the problem as a Markov decision process with constrained hybrid action space, which cannot be well handled by existing deep reinforcement learning (DRL) algorithms. Therefore, we develop a novel Deep Reinforcement Learning called Dirichlet Deep Deterministic Policy Gradient (D3PG), which is built on Deep Deterministic Policy Gradient (DDPG) to solve the problem. The developed model can learn to solve multi-objective optimization, including maximizing the number of tasks processed before expiration and minimizing the energy cost and service latency. More importantly, D3PG can effectively deal with constrained distribution-continuous hybrid action space, where the distribution variables are for the task partitioning and offloading, while the continuous variables are for computational frequency control. Moreover, the D3PG can address many similar issues in MEC and general reinforcement learning problems. Extensive simulation results show that the proposed D3PG outperforms the state-of-art methods.

A Deep Deterministic Policy Gradient-Based Method for Enforcing Service Fault-Tolerance in MEC

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

D3PG: Dirichlet DDPG for Task Partitioning and Offloading with Constrained Hybrid Action Space in Mobile Edge Computing

Energy-efficient edge intelligence for task-dependency MEC power grid networks

Optimal service caching, pricing and task partitioning in mobile edge computing federation

Dynamical Service Deployment and Replacement in Resource-Constrained Edges

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Achieving Deterministic Service in Mobile Edge Computing (MEC) Networks

Deep reinforcement learning-based microservice selection in mobile edge computing

PDMA: Probabilistic Service Migration Approach for Delay-aware and Mobility-aware Mobile Edge Computing

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Dynamic Resource Management in MEC Powered by Edge Intelligence for Smart City Internet of Things

Improved DDPG Based Two-Timescale Multi-Dimensional Resource Allocation for Multi-Access Edge Computing Networks

Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

SecEG: A Secure and Efficient Strategy against DDoS Attacks in Mobile Edge Computing

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Service caching decision-making policy for mobile edge computing using deep reinforcement learning