Abstract:The Unmanned Aerial Vehicles (UAVs) are competent to perform a variety of applications, possessing great potential and promise. The Deep Neural Network (DNN) technology has enabled the UAV-assisted paradigm, accelerated the construction of smart cities, and propelled the development of the Internet of Things (IoT). UAVs play an increasingly important role in various applications, such as surveillance, environmental monitoring, emergency rescue, supplies delivery, for which a robust path planning technique is the foundation and prerequisite. However, existing methods lack comprehensive consideration of the complicated urban environment and do not provide an overall assessment of the robustness and generalization. Meanwhile, due to the resource constraints and hardware limitations of UAVs, the complexity of deploying the network needs to be reduced. This paper proposes a lightweight, reinforcement learning-based real-time path planning method for UAVs, Adaptive Soft Actor-Critic algorithm (ASAC), which optimizing training process, network architecture, and algorithmic models. First of all, we establish a framework of global training and local adaptation, where the structured environment model is constructed for interaction, and local dynamically varying information aids in improving generalization. Secondly, ASAC introduces a cross-layer connection approach that passes the original state information into the higher layers to avoid feature loss and improve learning efficiency. Finally, we propose an adaptive temperature coefficient, which flexibly adjusts the exploration probability of UAVs with the training phase and experience data accumulation. In addition, a series of comparison experiments have been conducted in conjunction with practical application requirements, and the results have fully proved the favorable superiority of ASAC.

Deep Reinforcement Learning Based Freshness-Aware Path Planning for UAV-Assisted Edge Computing Networks with Device Mobility

Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Multi-UAV Mobile Edge Computing and Path Planning Platform based on Reinforcement Learning

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Priority-aware path planning and user scheduling for UAV-mounted MEC networks: A deep reinforcement learning approach

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

A Lightweight Reinforcement Learning-Based Real-Time Path Planning Method for Unmanned Aerial Vehicles

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Multi-UAV Path Learning for Age and Power Optimization in IoT With UAV Battery Recharge

Deep Reinforcement Learning-Based UAV Path Planning for Energy-Efficient Multitier Cooperative Computing in Wireless Sensor Networks

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning

Digital Twins-based Multi-agent Deep Reinforcement Learning for UAV-assisted Vehicle Edge Computing

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Towards Real-Time Path Planning through Deep Reinforcement Learning for a UAV in Dynamic Environments