Abstract:To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is a promising paradigm by providing computing capabilities in close proximity within a sliced radio access network (RAN), which supports both traditional communication and MEC services. Nevertheless, the design of computation offloading policies for a virtual MEC system remains challenging. Specifically, whether to execute a computation task at the mobile device or to offload it for MEC server execution should adapt to the time-varying network dynamics. In this paper, we consider MEC for a representative mobile user in an ultra-dense sliced RAN, where multiple base stations (BSs) are available to be selected for computation offloading. The problem of solving an optimal computation offloading policy is modelled as a Markov decision process, where our objective is to maximize the long-term utility performance whereby an offloading decision is made based on the task queue state, the energy queue state as well as the channel qualities between MU and BSs. To break the curse of high dimensionality in state space, we first propose a double deep Q-network (DQN) based strategic computation offloading algorithm to learn the optimal policy without knowing a priori knowledge of network dynamics. Then motivated by the additive structure of the utility function, a Q-function decomposition technique is combined with the double DQN, which leads to novel learning algorithm for the solving of stochastic computation offloading. Numerical experiments show that our proposed learning algorithms achieve a significant improvement in computation offloading performance compared with the baseline policies.

A Computational Offloading Strategy Based on Deep Reinforcement Learning in Small cell networks

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning Based Computation Offloading for Not Only Stack Architecture

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Computation Cost-Driven Offloading Strategy Based On Reinforcement Learning for Consumer Devices

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Online Task Offloading for 5G Small Cell Networks

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Reinforcement Learning-Based Mobile Offloading for Edge Computing Against Jamming and Interference

An efficient method of computation offloading in an edge cloud platform

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Deep Reinforcement Learning-Based Computation Offloading and Resource Allocation in IoT