Abstract:Unmanned Aerial Vehicles (UAVs), with their high levels of flexibility and maneuverability, can greatly enhance the capabilities of Mobile Edge Computing (MEC) by acting as edge computing servers. In practice, however, it is often challenging to jointly optimize the flying trajectories of UAVs and the offloading decisions of tasks, due to the fast and randomly changing of physical environments. In this work, we investigate an UAV-enable MEC network with the assistance of Digital Twin (DT), where a DT layer is introduced to simulate the Physical Entity (PE) layer, generate different strategies, and evaluate their performances. Specifically, we formulate a joint flying trajectories, task offloading, and resource allocation problem on the DT layer, aiming at minimizing both task delay and energy consumption, under the maximum tolerated delay and resource constraints. To solve the problem in an online distributed manner and implement the derived strategies on the real PE layer, we propose a hierarchical learning approach, which consists of a Deep Reinforcement Learning (DRL) module and a Constrained Optimization (CO) module. First, the DRL module determines the UAVs' flying trajectories. Then, the CO module determines the MDs' task offloading decisions and the associated resource allocations, given the UAV s' flying decisions. Finally, the outputs of both modules are combined together to train the DRL module by using the Deep Deterministic Policy Gradient (DDPG) method. Experiment results show that our proposed DT-assisted scheme outperforms existing benchmark schemes in terms of both task delay and energy cost.

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

Computing over the Sky: Joint UAV Trajectory and Task Offloading Scheme Based on Optimization-Embedding Multi-Agent Deep Reinforcement Learning

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

A Joint Trajectory and Computation Offloading Scheme for UAV-MEC Networks Via Multi-Agent Deep Reinforcement Learning.

Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach

Joint Task Offloading, Resource Allocation, and Trajectory Design for Multi-UAV Cooperative Edge Computing with Task Priority

Multi-Agent Collaborative Optimization of UAV Trajectory and Latency-Aware DAG Task Offloading in UAV-Assisted MEC

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Fairness-Aware Computation Offloading with Trajectory Optimization and Phase-Shift Design in RIS-Assisted Multi-UAV MEC Network

Multi-Agent Deep Reinforcement Learning Based UAV Trajectory Optimization for Differentiated Services

Joint Trajectory Optimization and Task Offloading for UAV-Assisted Mobile Edge Computing

Trajectory and Offloading Policy Optimization in Age-of-Information-Aware UAV-Assisted MEC Systems

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Service Placement and Trajectory Design for Heterogeneous Tasks in Multi-UAV Cooperative Computing Networks

Multi-UAV Assisted Air–Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization

Joint Optimization of Flying Trajectory and Task Offloading for UAV-Enabled MEC Networks: A Digital Twin-Assisted Hybrid Learning Approach

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing