Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Distributed Computation Offloading and Power Control for UAV-Enabled Internet of Medical Things

Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System

An UAV-assisted mobile edge computing offloading strategy for minimizing energy consumption

Energy-Efficient Computation Offloading for UAV-Assisted MEC: A Two-Stage Optimization Scheme

UAV-assisted cooperative offloading energy efficiency system for mobile edge computing

An O-MAPPO scheme for joint computation offloading and resources allocation in UAV assisted MEC systems

3D Multi-UAV Computing Networks: Computation Capacity and Energy Consumption Tradeoff

Computation‐efficiency‐oriented resource optimization in NOMA‐assisted multi‐UAV‐enabled MEC networks

Research on weighted energy consumption and delay optimization algorithm based on dual-queue model

Energy-Efficient UAV-Enabled MEC System: Bits Allocation Optimization and Trajectory Design

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks

Joint Computation and Communication Design for UAV-Assisted Mobile Edge Computing in IoT

Energy-Efficient Computation Offloading for Secure UAV-Edge-Computing Systems.

Resource Allocation and Offloading Decision for Secure UAV-based MEC Wireless-Powered System

Energy-Efficient Resource Allocation for Dual-NOMA-UAV Assisted Internet of Things

Collaboration in the Sky: A Distributed Framework for Task Offloading and Resource Allocation in Multi-Access Edge Computing

A Novel Energy-Efficient and Cost-Effective Task Offloading Approach for UAV-Enabled MEC with LEO Enhancement in Internet of Remote Things Networks

UAV-assisted MEC offloading strategy with peak AOI boundary optimization: A method based on DDQN

Dependency Tasks Offloading and Communication Resource Allocation in Collaborative UAV Networks: A Metaheuristic Approach

Distributed Offloading for Multi-UAV Swarms in MEC-Assisted 5G Heterogeneous Networks