Abstract:The Unmanned Aerial Vehicles (UAVs) are competent to perform a variety of applications, possessing great potential and promise. The Deep Neural Network (DNN) technology has enabled the UAV-assisted paradigm, accelerated the construction of smart cities, and propelled the development of the Internet of Things (IoT). UAVs play an increasingly important role in various applications, such as surveillance, environmental monitoring, emergency rescue, supplies delivery, for which a robust path planning technique is the foundation and prerequisite. However, existing methods lack comprehensive consideration of the complicated urban environment and do not provide an overall assessment of the robustness and generalization. Meanwhile, due to the resource constraints and hardware limitations of UAVs, the complexity of deploying the network needs to be reduced. This paper proposes a lightweight, reinforcement learning-based real-time path planning method for UAVs, Adaptive Soft Actor-Critic algorithm (ASAC), which optimizing training process, network architecture, and algorithmic models. First of all, we establish a framework of global training and local adaptation, where the structured environment model is constructed for interaction, and local dynamically varying information aids in improving generalization. Secondly, ASAC introduces a cross-layer connection approach that passes the original state information into the higher layers to avoid feature loss and improve learning efficiency. Finally, we propose an adaptive temperature coefficient, which flexibly adjusts the exploration probability of UAVs with the training phase and experience data accumulation. In addition, a series of comparison experiments have been conducted in conjunction with practical application requirements, and the results have fully proved the favorable superiority of ASAC.

DAWN: Dynamic Task Planning of Multi-UAV With Two-Layer Optimization Mechanism in Uncertain Environments

DRL-UTPS: DRL-Based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network

DL-DRL: A double-level deep reinforcement learning approach for large-scale task scheduling of multi-UAV

Dynamic Online Trajectory Planning for a UAV-Enabled Data Collection System

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Digital Twin Assisted Task Assignment in Multi-UAV Systems: A Deep Reinforcement Learning Approach

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Reinforcement Learning Assisted Multi-UAV Task Allocation and Path Planning for IIoT

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

Joint Optimization of Deployment and Flight Planning of Multi-UAVs for Long-distance Data Collection from Large-scale IoT Devices

Multi-UAVs cooperative task assignment and path planning scheme

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

A distributed framework for multiple UAV cooperative target search under dynamic environment

Joint Optimization of Flying Trajectory and Task Offloading for UAV-Enabled MEC Networks: A Digital Twin-Assisted Hybrid Learning Approach

Study on Multi-UAV Cooperative Path Planning for Complex Patrol Tasks in Large Cities

A hybrid optimization framework for UAV reconnaissance mission planning

Delay-Informed Intelligent Formation Control for UAV-Assisted IoT Application

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

A Lightweight Reinforcement Learning-Based Real-Time Path Planning Method for Unmanned Aerial Vehicles

Joint Deployment Optimization and Flight Trajectory Planning for UAV Assisted IoT Data Collection: A Bilevel Optimization Approach