Abstract:Deploying unmanned aerial vehicles (UAVs) as mobile edge computing (MEC) servers has been attracting significant attention, since the UAVs' inherent maneuverability and mobility can further reduce the distance between the users and computational functionalities. In the UAV-assisted MEC systems, the caching and offloading decision optimization, subject to the computation and energy constraints of the UAVs, is one of the key design issues. Against this backdrop, in this paper, we propose a novel cloud-edge framework to facilitate MEC in the UAV networks. Specifically, in our framework, the edge UAVs (EUAVs), together with the cloud, provide caching and computing services for the terrestrial users. In order to minimize the weighted sum cost of latency and energy consumption, we jointly optimize the caching and offloading decisions, the EUAV deployment, the radio and computation resource allocation, while simultaneously satisfying the UAVs' cache and computation capacity constraints, as well as the users' latency and energy consumption constraints. To solve this NP-hard problem, we propose a sequential convex programming (SCP) and sequential quadratic programming (SQP) based deep Q-learning (SS-DQN) algorithm. The proposed algorithm allows the system to adaptively adjust caching and offloading decisions with the EUAV deployment scheme and the resource allocation scheme obtained by SCP and SQP algorithms, respectively. Simulation results verify the superiority of our proposed algorithm compared to two benchmark schemes, and demonstrate how the combination of DRL and convex optimization can improve the system performance significantly.

Cost Optimization of UAV-MEC Network Calculation Offloading: A Multi-Agent Reinforcement Learning Method

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

Energy Consumption Modeling and Optimization of UAV-Assisted MEC Networks Using Deep Reinforcement Learning

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

Resource optimization for UAV-assisted mobile edge computing system based on deep reinforcement learning

A Load-Balanced and Energy-Efficient Navigation Scheme for UAV-Mounted Mobile Edge Computing

Computation Offloading in Multi-UAV-Enhanced Mobile Edge Networks: A Deep Reinforcement Learning Approach

Distributed Access and Offloading Scheme for Multiple UAVs Assisted MEC Networks

Trajectory and Offloading Policy Optimization in Age-of-Information-Aware UAV-Assisted MEC Systems

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks.

Computing over the Sky: Joint UAV Trajectory and Task Offloading Scheme Based on Optimization-Embedding Multi-Agent Deep Reinforcement Learning

Energy Consumption Optimization of Unmanned Aerial Vehicle Assisted Mobile Edge Computing Systems Based on Deep Reinforcement Learning

Semi-Distributed Resource Management in UAV-Aided MEC Systems: A Multi-Agent Federated Reinforcement Learning Approach

Task offloading and trajectory scheduling for UAV-enabled MEC networks: An MADRL algorithm with prioritized experience replay

UAV-Assisted Task Offloading Strategy for Mobile Edge Computing

Computation Offloading and Resource Allocation in Unmanned Aerial Vehicle Networks.

Efficient UAV/Satellite-assisted IoT Task Offloading: A Multi-agent Reinforcement Learning Solution

Multi-objective Deep Reinforcement Learning for Computation offloading in UAV-Assisted Multi-Access Edge Computing

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach