Abstract:To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is a promising paradigm by providing computing capabilities in close proximity within a sliced radio access network (RAN), which supports both traditional communication and MEC services. Nevertheless, the design of computation offloading policies for a virtual MEC system remains challenging. Specifically, whether to execute a computation task at the mobile device or to offload it for MEC server execution should adapt to the time-varying network dynamics. In this paper, we consider MEC for a representative mobile user in an ultra-dense sliced RAN, where multiple base stations (BSs) are available to be selected for computation offloading. The problem of solving an optimal computation offloading policy is modelled as a Markov decision process, where our objective is to maximize the long-term utility performance whereby an offloading decision is made based on the task queue state, the energy queue state as well as the channel qualities between MU and BSs. To break the curse of high dimensionality in state space, we first propose a double deep Q-network (DQN) based strategic computation offloading algorithm to learn the optimal policy without knowing a priori knowledge of network dynamics. Then motivated by the additive structure of the utility function, a Q-function decomposition technique is combined with the double DQN, which leads to novel learning algorithm for the solving of stochastic computation offloading. Numerical experiments show that our proposed learning algorithms achieve a significant improvement in computation offloading performance compared with the baseline policies.

Computing Offloading with Fairness Guarantee: A Deep Reinforcement Learning Method

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

When Learning Joins Edge: Real-Time Proportional Computation Offloading Via Deep Reinforcement Learning

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing

Collaborative Computation Offloading and Resource Management in Space–Air–Ground Integrated Networking: A Deep Reinforcement Learning Approach

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Multiagent Reinforcement Learning for Task Offloading of Space/Aerial-Assisted Edge Computing

A computational offloading optimization scheme based on deep reinforcement learning in perceptual network

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing