Abstract:Mobile edge computing (MEC) is a promising solution to support resource-constrained devices by offloading tasks to the edge servers. However, traditional approaches (e.g., linear programming and game-theory methods) for computation offloading mainly focus on the immediate performance, potentially leading to performance degradation in the long run. Recent breakthroughs regarding deep reinforcement learning (DRL) provide alternative methods, which focus on maximizing the cumulative reward. Nonetheless, there exists a large gap to deploy real DRL applications in MEC. This is because: 1) training a well-performed DRL agent typically requires data with large quantities and high diversity, and 2) DRL training is usually accompanied by huge costs caused by trial-and-error. To address this mismatch, we study the applications of DRL on the multi-user computation offloading problem from a more practical perspective. In particular, we propose a distributed and collective DRL algorithm called DC-DRL with several improvements: 1) a distributed and collective training scheme that assimilates knowledge from multiple MEC environments, which not only greatly increases data amount and diversity but also spreads the exploration costs, 2) an updating method called adaptive n-step learning, which can improve training efficiency without suffering from the high variance caused by distributed training, and 3) combining the advantages of deep neuroevolution and policy gradient to maximize the utilization of multiple environments and prevent the premature convergence. Lastly, evaluation results demonstrate the effectiveness of our proposed algorithm. Compared with the baselines, the exploration costs and final system costs are reduced by at least 43 and 9.4 percent, respectively.

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Backscatter-Aided Hybrid Data Offloading for Mobile Edge Computing via Deep Reinforcement Learning

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Distributed and Collective Deep Reinforcement Learning for Computation Offloading: A Practical Perspective.

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Dynamic Edge Computation Offloading for Internet of Things with Energy Harvesting: A Learning Method.

A Multi-Agent Deep Reinforcement Learning Approach for Computation Offloading in 5G Mobile Edge Computing

Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing

Multi-Agent Deep Reinforcement Learning for Efficient Computation Offloading in Mobile Edge Computing

Multi-user Computation Offloading for Mobile Edge Computing: A Deep Reinforcement Learning and Game Theory Approach

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing