Abstract:Unmanned Aerial Vehicles (UAVs), with their high levels of flexibility and maneuverability, can greatly enhance the capabilities of Mobile Edge Computing (MEC) by acting as edge computing servers. In practice, however, it is often challenging to jointly optimize the flying trajectories of UAVs and the offloading decisions of tasks, due to the fast and randomly changing of physical environments. In this work, we investigate an UAV-enable MEC network with the assistance of Digital Twin (DT), where a DT layer is introduced to simulate the Physical Entity (PE) layer, generate different strategies, and evaluate their performances. Specifically, we formulate a joint flying trajectories, task offloading, and resource allocation problem on the DT layer, aiming at minimizing both task delay and energy consumption, under the maximum tolerated delay and resource constraints. To solve the problem in an online distributed manner and implement the derived strategies on the real PE layer, we propose a hierarchical learning approach, which consists of a Deep Reinforcement Learning (DRL) module and a Constrained Optimization (CO) module. First, the DRL module determines the UAVs' flying trajectories. Then, the CO module determines the MDs' task offloading decisions and the associated resource allocations, given the UAV s' flying decisions. Finally, the outputs of both modules are combined together to train the DRL module by using the Deep Deterministic Policy Gradient (DDPG) method. Experiment results show that our proposed DT-assisted scheme outperforms existing benchmark schemes in terms of both task delay and energy cost.

Computing over the Sky: Joint UAV Trajectory and Task Offloading Scheme Based on Optimization-Embedding Multi-Agent Deep Reinforcement Learning

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

Joint Task Offloading, Resource Allocation, and Trajectory Design for Multi-UAV Cooperative Edge Computing with Task Priority

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Joint Optimization of Flying Trajectory and Task Offloading for UAV-Enabled MEC Networks: A Digital Twin-Assisted Hybrid Learning Approach

Task offloading and trajectory scheduling for UAV-enabled MEC networks: An MADRL algorithm with prioritized experience replay

Multi-Agent Collaborative Optimization of UAV Trajectory and Latency-Aware DAG Task Offloading in UAV-Assisted MEC

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems

Service Placement and Trajectory Design for Heterogeneous Tasks in Multi-UAV Cooperative Computing Networks

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Multi-agent Deep Reinforcement Learning-based Trajectory Design for UAV-aided Edge Computing System.

Multi-UAV Assisted Air–Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Dynamic Trajectory Design and Bandwidth Adjustment for Energy-Efficient UAV-Assisted Relaying with Deep Reinforcement Learning in MEC IoT System

Trajectory Design and Resource Allocation for Multi-UAV-Assisted Sensing, Communication, and Edge Computing Integration