Abstract:The recent advancements of mobile edge computing (MEC) technologies and unmanned aerial vehicles (UAVs) have provided resilient and flexible computation services for ground users beyond the coverage of terrestrial service. In this paper, we focus on a UAV-assisted MEC system in which the UAV equipped with MEC servers is used to assist user devices in computing their tasks. To minimize the weighted average energy consumption and delay in the UAV-assisted MEC system, a LQR-Lagrange-based DDPG (LLDDPG) algorithm, which jointly optimizes the user task offloading and the UAV trajectory design, is proposed. To be specific, the LLDDPG algorithm consists of three subproblems. The DDPG algorithm is used to address the issue of UAV desired trajectory planning, and subsequently, the LQR-based algorithm is employed to achieve the real-time tracking control of UAV desired trajectory. Finally, the Lagrange duality method is proposed to solve the optimization problem of computational resource allocation. Simulation results indicate that the proposed LLDDPG algorithm can effectively improve the system resource management and realize the real-time UAV trajectory design.

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper primarily focuses on the dynamic trajectory design and resource allocation issues in UAV-assisted Mobile Edge Computing (UAV-MEC) systems. Specifically, the paper aims to minimize the system's weighted average energy consumption and delay by jointly optimizing the user task offloading strategy and the UAV flight trajectory. #### Main Research Content 1. **System Architecture and Model Analysis**: - Considered the dynamic control of UAVs and studied the architecture of the UAV-MEC system. - Conducted a detailed analysis of the communication model, UAV control model, and computation and transmission model. - Proposed a joint optimization problem for weighted energy consumption and delay, considering UAV dynamics constraints. 2. **Algorithm Design**: - Proposed a deep deterministic policy gradient (DDPG) algorithm based on Linear Quadratic Regulator (LQR) and Lagrangian dual method (LLDDPG) to solve the joint optimization problem of dynamic computing resources and UAV flight trajectory. - The algorithm is divided into three sub-problems for solution: - Used the DDPG algorithm to obtain the desired optimal trajectory. - Introduced a tracking control algorithm based on LQR to derive the actual flight trajectory based on the actual UAV dynamics constraints. - Utilized the Lagrangian dual method to solve the resource allocation problem of task offloading ratio and computing frequency allocation. 3. **Numerical Simulation Results**: - Extensively validated the effectiveness of the proposed LLDDPG algorithm in terms of learning rate, loss function, and reward convergence through numerical simulations. - Evaluated the performance under different weight parameters and analyzed the effectiveness of the LLDDPG algorithm in actual UAV flight control. ### Summary The paper aims to address the deviation problem between the actual flight trajectory and the theoretical design trajectory in UAV-MEC systems due to UAV dynamics constraints. By proposing a new LLDDPG algorithm, it achieves optimization of dynamic trajectory design and resource allocation, thereby improving the overall performance of the system.

UAV-Assisted Mobile Edge Computing: Dynamic Trajectory Design and Resource Allocation

Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks

Energy-Efficient UAV-Enabled MEC System: Bits Allocation Optimization and Trajectory Design

Multi-UAV Enabled MEC Networks: Optimizing Delay through Intelligent 3D Trajectory Planning and Resource Allocation

Joint Task Offloading, Resource Allocation, and Trajectory Design for Multi-UAV Cooperative Edge Computing with Task Priority

Dynamic UAV routing for multi-access edge computing

Efficient Trajectory Planning and Dynamic Resource Allocation for UAV-Enabled MEC System

Mobile Edge Computing for Cellular-Connected UAV: Computation Offloading and Trajectory Optimization

Heterogeneous UAVs assisted mobile edge computing for energy consumption minimization of the edge side

Joint Trajectory and Resource Optimization for UAV and D2D-enabled Heterogeneous Edge Computing Networks

An UAV-assisted mobile edge computing offloading strategy for minimizing energy consumption

UAV-Assisted Wireless Powered Cooperative Mobile Edge Computing: Joint Offloading, CPU Control, and Trajectory Optimization

Lyapunov-Based Joint Flight Trajectory and Computation Offloading Optimization for UAV-Assisted Vehicular Networks

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Energy-efficient Mobile Edge Computing Assisted by Layered UAVs Based on Convex Optimization

Joint Computation and Communication Design for UAV-Assisted Mobile Edge Computing in IoT

Multi-Agent Collaborative Optimization of UAV Trajectory and Latency-Aware DAG Task Offloading in UAV-Assisted MEC

Multi-UAV Assisted Air–Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization

Resource Allocation and 3D Deployment of UAVs-Assisted MEC Network with Air-Ground Cooperation