Abstract:To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is a promising paradigm by providing computing capabilities in close proximity within a sliced radio access network (RAN), which supports both traditional communication and MEC services. Nevertheless, the design of computation offloading policies for a virtual MEC system remains challenging. Specifically, whether to execute a computation task at the mobile device or to offload it for MEC server execution should adapt to the time-varying network dynamics. In this paper, we consider MEC for a representative mobile user in an ultra-dense sliced RAN, where multiple base stations (BSs) are available to be selected for computation offloading. The problem of solving an optimal computation offloading policy is modelled as a Markov decision process, where our objective is to maximize the long-term utility performance whereby an offloading decision is made based on the task queue state, the energy queue state as well as the channel qualities between MU and BSs. To break the curse of high dimensionality in state space, we first propose a double deep Q-network (DQN) based strategic computation offloading algorithm to learn the optimal policy without knowing a priori knowledge of network dynamics. Then motivated by the additive structure of the utility function, a Q-function decomposition technique is combined with the double DQN, which leads to novel learning algorithm for the solving of stochastic computation offloading. Numerical experiments show that our proposed learning algorithms achieve a significant improvement in computation offloading performance compared with the baseline policies.

Task Offloading Algorithm in Edge Computing Based on DQN

Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Computation Offloading for Workflow in Mobile Edge Computing Based on Deep Q-Learning

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Dynamic Task Offloading in MEC-Enabled IoT Networks - A Hybrid DDPG-D3QN Approach.

Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Offloading Strategy for Dependency-Aware Tasks in MEC System Based on Deep Q-network

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Q-learning Based Computation Offloading Algorithm in Mobile Edge Computing

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

QECO: A QoE-Oriented Computation Offloading Algorithm based on Deep Reinforcement Learning for Mobile Edge Computing

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

A Novel Task Offloading Algorithm Based on an Integrated Trust Mechanism in Mobile Edge Computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

A DRL-based Algorithm for Dependent Task Offloading in Multi-access Edge Computing

A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing