Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

Joint Computation Offloading and Resource Allocation for MEC-Enabled IoT Systems with Imperfect CSI

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Mobility-aware task offloading in MEC with task migration and result caching

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Collaborative Cloud-Edge-End Task Offloading in MEC-Based Small Cell Networks with Distributed Wireless Backhaul

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Deep Reinforcement Learning Based Task Offloading and Resource Allocation in Small Cell MEC

Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms

Deep reinforcement learning based adaptive threshold multi-tasks offloading approach in MEC

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Task offloading mechanism based on federated reinforcement learning in mobile edge computing

Mobility-Aware Computation Offloading With Load Balancing in Smart City Networks Using MEC Federation

Mobility-Aware Joint Task Scheduling and Resource Allocation for Cooperative Mobile Edge Computing

Task Offloading Optimization for Mobile Edge Computing System: A CNO Approach

Dynamic adaptive workload offloading strategy in mobile edge computing networks

Service‐dependent Task Offloading for Multiuser Mobile Edge Computing System

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Energy-Aware and Mobility-Driven Computation Offloading in MEC

Joint Task Secure Offloading and Resource Allocation for Multi-MEC Server to Improve User QoE.