Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Online Edge Learning Offloading and Resource Management for UAV-Assisted MEC Secure Communications

Secure Offloading in NOMA-Aided Aerial MEC Systems Based on Deep Reinforcement Learning

Secure Enhancement in NOMA-based UAV-MEC Networks

Energy-Efficient Computation Offloading for Secure UAV-Edge-Computing Systems.

Resource and Trajectory Optimization for UAV-Relay-Assisted Secure Maritime MEC

Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

Resource and Trajectory Optimization for Secure Communications in Dual Unmanned Aerial Vehicle Mobile Edge Computing Systems

Secure Transmission for Multi-UAV-Assisted Mobile Edge Computing Based on Reinforcement Learning

QoE Maximization for Multiple-UAV-Assisted Multi-Access Edge Computing: An Online Joint Optimization Approach

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks

Heterogeneous UAVs assisted mobile edge computing for energy consumption minimization of the edge side

Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System

Resource Allocation and Offloading Decision for Secure UAV-based MEC Wireless-Powered System

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

An enhanced energy efficiency scheme for secure computing in UAV-MEC networks

Distributed Offloading for Multi-UAV Swarms in MEC-Assisted 5G Heterogeneous Networks

Q-learning based computation offloading for multi-UAV-enabled cloud-edge computing networks

A security optimization scheme for data security transmission in UAV-assisted edge networks based on Federal Learning