Abstract:Mobile edge computing (MEC) has recently emerged as a promising paradigm to meet the increasing computation demands in Internet of Things (IoT). However, due to the limited computation capacity of the MEC server, an efficient computation offloading scheme, which means the IoT device decides whether to offload the generated data to the MEC server, is needed. Considering the limited battery capacity of IoT devices, energy harvesting (EH) is introduced to enhance the lifetime of the IoT systems. However, due to the unpredictability nature of the generated data and the harvested energy, it is a challenging problem when designing an effective computation offloading scheme for the EH MEC system. To cope with this problem, we model the computation offloading process as a Markov decision process (MDP) so that no prior statistic information is needed. Then, reinforcement learning algorithms can be adopted to derive the optimal offloading policy. To address the large time complexity challenge of learning algorithms, we first introduce an after-state for each state-action pair so that the number of states in the formulated MDP is largely decreased. Then, to deal with the continuous state space challenge, a polynomial value function approximation method is introduced to accelerate the learning process. Thus, an after-state reinforcement learning algorithm for the formulated MDP is proposed to obtain the optimal offloading policy. To provide efficient instructions for real MEC systems, several analytical properties of the offloading policy are also presented. Our simulation results validate the great performance of our proposed algorithm, which significantly improves the achieved system reward under a reasonable complexity.

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

DRL‐based computing offloading approach for large‐scale heterogeneous tasks in mobile edge computing

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Dynamic Edge Computation Offloading for Internet of Things with Energy Harvesting: A Learning Method.

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

A Multi-Agent Deep Reinforcement Learning Approach for Computation Offloading in 5G Mobile Edge Computing

Joint Computation Offloading and Service Caching in Mobile Edge-Cloud Computing Via Deep Reinforcement Learning

Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.