Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Efficient Resources Allocation and Computation Offloading Model for AP-based Edge Cloud

CampEdge: Distributed Computation Offloading Strategy under Large-Scale AP-Based Edge Computing System for IoT Applications.

Energy-Efficient Joint Offloading and Wireless Resource Allocation Strategy in Multi-MEC Server Systems.

Joint Computation Offloading and Resource Allocation for MEC-Enabled IoT Systems with Imperfect CSI

Latency Optimization for Resource Allocation in Mobile-Edge Computation Offloading.

Collaborative Data Caching and Computation Offloading for Multi-Service Mobile Edge Computing

Long-term optimization for MEC-enabled HetNets with device–edge–cloud collaboration

Efficient Computation Offloading for Edge-cloud Collaborative Networks

Energy-Efficient Resource Allocation for Heterogeneous Edge-Cloud Computing

Energy-Latency Aware Offloading For Hierarchical Mobile Edge Computing

Cost-Aware Computation Offloading and Resource Allocation in Ultra-Dense Multi-Cell, Multi-User and Multi-Task MEC Networks

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Cooling-Aware Resource Allocation and Load Management for Mobile Edge Computing Systems

Energy-Efficient Resource Allocation for Slicing-enabled Multi-access Edge Computing.

Dynamic Task Offloading and Resource Allocation for Mobile-Edge Computing in Dense Cloud RAN

Multiuser Computation Offloading and Resource Allocation for Cloud–Edge Heterogeneous Network

Optimal Resource Allocation for Wireless Powered Mobile Edge Computing with Dynamic Task Arrivals

Multiuser Computation Offloading and Downloading for Edge Computing with Virtualization

Multi-edge collaborative offloading and energy threshold-based task migration in mobile edge computing environment

Optimal multi-user offloading with resources allocation in mobile edge cloud computing

Efficient Resource Allocation for On-Demand Mobile-Edge Cloud Computing