Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Dynamic Computation Offloading and Server Deployment for UAV-Enabled Multi-Access Edge Computing

Cost-efficient Computation Offloading in UAV-enabled Edge Computing.

UAV-Aided Computation Offloading in Mobile-Edge Computing Networks: A Stackelberg Game Approach

Minimization Of Offloading Delay For Two-Tier Uav With Mobile Edge Computing

A Mobile Edge Computing Framework for Task Offloading and Resource Allocation in UAV-assisted VANETs

Joint Task Offloading, Resource Allocation, and Security Assurance for Mobile Edge Computing-Enabled UAV-Assisted VANETs

Offloading Strategy for UAV-Assisted Mobile Edge Computing with Computation Rate Maximization.

Computation Offloading and Resource Allocation in Unmanned Aerial Vehicle Networks.

UAV-Assisted Mobile Edge Computing Task Offloading Based on Mixed-Strategy Games

Intelligent task offloading and collaborative computation in multi-UAV-enabled mobile edge computing

Energy–Latency Tradeoff for Computation Offloading in UAV-Assisted Multiaccess Edge Computing System

Timeliness-Oriented Asynchronous Task Offloading in UAV-Edge-Computing Systems

Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

Stackelberg Game-Based Intelligent Offloading Incentive Mechanism for a Multi-UAV-Assisted Mobile Edge Computing System

Joint Game Theory and Greedy Optimization Scheme of Computation Offloading for UAV-Aided Network

Computation Offloading in Multi-UAV-Enhanced Mobile Edge Networks: A Deep Reinforcement Learning Approach

Distributed Task Offloading Game in Multiserver Mobile Edge Computing Networks

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Q-learning based computation offloading for multi-UAV-enabled cloud-edge computing networks

Joint Computation Offloading and Variable-width Channel Access Optimization in UAV Swarms

Cost-Efficient Task Offloading in Mobile Edge Computing with Layered Unmanned Aerial Vehicles