Abstract:Inthis paper, we investigate an unmanned aerial vehicle (UAV)-assisted edge computing network in a sophisticated three-dimensional (3D) scenario, e.g., a post-disaster urban area with multiple mobile ground terminals (GTs) for resilience. The mission of the UAV is to first collect a set of computation tasks from multiple GT sources, then process them and make joint decisions (computation results) which are finally transmitted to another set of GT destinations. An efficient design is provided aiming at minimizing the total time cost including costs for the task offloading, computations, and decision transmissions, via jointly designing the UAV's trajectory and the scheduling of communications from and to different GTs. In particular, we take into account the practical assumptions on the GTs' mobility, on the obstacle avoidance to 3D buildings, and on that the UAV is possible to fly among buildings, i.e., the flying altitude can be lower than the buildings' heights. To address the established complex and non-convex problem, we first provide a problem transformation by exploiting Markov decision process (MDP), and then propose a deep reinforcement learning (DRL) approach-based solution with a multi-step dueling DDQN (D3QN) method. As a result, an efficient solution is achieved, where the UAV acts as the agent to continuously explore and improve its mobile strategy during interacting with the environment under the proposed method. The simulation results show the advantages of the proposed 3D trajectory design in comparison to a 2D one. In addition, the results confirm the robustness of the proposed design in terms of different GTs' mobility models and UAV flying height/area limits, and illustrate the superiority of unrestricted feasible domains for the UAV flight.

Deep Reinforcement Learning-Based Trajectory Optimization and Resource Allocation for Secure UAV-Enabled MEC Networks

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Resource and Trajectory Optimization for Secure Communications in Dual Unmanned Aerial Vehicle Mobile Edge Computing Systems

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Green MEC Networks Design Under UAV Attack: A Deep Reinforcement Learning Approach

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Resource and Trajectory Optimization for UAV-Relay-Assisted Secure Maritime MEC

UAV Trajectory Optimization for Large-Scale and Low-Power Data Collection: An Attention-Reinforced Learning Scheme

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

Ellipsoidal Trajectory Optimization for Minimizing Latency and Data Transmission Energy in UAV-Assisted MEC Using Deep Reinforcement Learning

Toward Optimal Resource Allocation: A Multi-Agent DRL Based Task Offloading Approach in Multi-UAV-Assisted MEC Networks

The Codevelopment of Sympathy and Overt Aggression From Middle Childhood to Early Adolescence

UAV-Assisted Mobile Edge Computing: Dynamic Trajectory Design and Resource Allocation

Three-dimensional deep reinforcement learning for trajectory and resource optimization in UAV communication systems

UAV-Assisted MEC System With Mobile Ground Terminals: DRL-Based Joint Terminal Scheduling and UAV 3D Trajectory Design

Energy Saving Strategy of UAV in MEC Based on Deep Reinforcement Learning

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

UAV-Mounted RIS-Aided Mobile Edge Computing System: A DDQN-Based Optimization Approach

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning