Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

An O-MAPPO scheme for joint computation offloading and resources allocation in UAV assisted MEC systems

Energy-Efficient Joint Offloading and Wireless Resource Allocation Strategy in Multi-MEC Server Systems.

Energy-Efficient Computation Offloading for UAV-Assisted MEC: A Two-Stage Optimization Scheme

Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks

Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System

Resource Allocation and Offloading Decision for Secure UAV-based MEC Wireless-Powered System

Deep Reinforcement Learning Based Computation Offloading in Heterogeneous MEC Assisted by Ground Vehicles and Unmanned Aerial Vehicles

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Energy-Efficient Resource Management for Multi-UAV-Enabled Mobile Edge Computing

Joint Energy and AoI Optimization in UAV-assisted MEC-WET Systems

Distributed Computation Offloading and Power Control for UAV-Enabled Internet of Medical Things

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

UAV-assisted cooperative offloading energy efficiency system for mobile edge computing

Joint Multi-task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT

Computation‐efficiency‐oriented resource optimization in NOMA‐assisted multi‐UAV‐enabled MEC networks

Collaboration in the Sky: A Distributed Framework for Task Offloading and Resource Allocation in Multi-Access Edge Computing

Multi-agent Cooperation for Computing Power Scheduling in UAVs Empowered Aerial Computing Systems

A Two Time-Scale Joint Optimization Approach for UAV-assisted MEC

An Online Joint Optimization Approach for QoE Maximization in UAV-Enabled Mobile Edge Computing