Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Energy-efficient UAV-enabled Computation Offloading for Industrial Internet of Things: a Deep Reinforcement Learning Approach

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

UAV-assisted Task Offloading for IoT in Smart Buildings and Environment Via Deep Reinforcement Learning

Computation Offloading Via Multi-Agent Deep Reinforcement Learning in Aerial Hierarchical Edge Computing Systems

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

A PDDQNLP Algorithm for Energy Efficient Computation Offloading in UAV-Assisted MEC

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Deep Reinforcement Learning-Based Energy Minimization Task Offloading and Resource Allocation for Air Ground Integrated Heterogeneous Networks

Multi-objective Deep Reinforcement Learning for Computation offloading in UAV-Assisted Multi-Access Edge Computing

Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System

Energy Saving Strategy of UAV in MEC Based on Deep Reinforcement Learning

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Q-learning based computation offloading for multi-UAV-enabled cloud-edge computing networks

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Learning-Based Computation Offloading Approaches in UAVs-Assisted Edge Computing