Abstract:Unmanned aerial vehicle (UAV) navigation plays a crucial role in its ability to perform autonomous missions in complex environments. Most of the existing reinforcement learning methods to solve the UAV navigation problem fix the flight altitude and velocity, which largely reduces the difficulty of the algorithm. But the methods without adaptive control are not suitable in low-altitude environments with complex situations, generally suffering from weak obstacle avoidance. Some UAV navigation studies with adaptive flight only have weak obstacle avoidance capabilities. To address the problem of UAV navigation in low-altitude environments, we construct autonomous UAV navigation in 3D environments with adaptive control as a Markov decision process and propose a deep reinforcement learning algorithm. To solve the problem of weak obstacle avoidance, we creatively propose the guide attention method to make a UAV's decision focus shift between the navigation task and obstacle avoidance task according to changes in the obstacle. We raise a novel velocity-constrained loss function and add it to the original actor loss to improve the UAV's velocity control capability. Simulation experiment results demonstrate that our algorithm outperforms some of the state-of-the-art deep reinforcement learning algorithms performing UAV navigation tasks in a 3D environment and has outstanding performance in algorithm effectiveness, with the average reward increasing by 9.35, the success rate of navigation tasks increasing by 14%, and the collision rate decreasing by 14%.

Fault-Tolerant Control for Multi-UAV Exploration System via Reinforcement Learning Algorithm

Fault-tolerant Control for Unmanned Aerial Vehicle Using Deep Reinforcement Learning

Adaptive dynamic programming–based fault-tolerant control of multi-UAV formation system

Fault Tolerant Dynamic Task Assignment for UAV-based Search Teams

Multi-UAV Collaborative Surveillance Network Recovery Via Deep Reinforcement Learning

UAV Swarm Exploration with Byzantine Fault Tolerance

Research on the Multiagent Joint Proximal Policy Optimization Algorithm Controlling Cooperative Fixed-Wing UAV Obstacle Avoidance

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Distributed Adaptive Fault-Tolerant Formation–Containment Control With Prescribed Performance for Heterogeneous Multiagent Systems

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Distributed Adaptive Fault-Tolerant Formation Control for Heterogeneous Multiagent Systems With Communication Link Faults

Fault-tolerant cooperative navigation of networked UAV swarms for forest fire monitoring

Adaptive Fault-Tolerant Formation Control of Heterogeneous Multi-Agent Systems under Directed Communication Topology

Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning

Multi-Agent Reinforcement Learning for Unmanned Aerial Vehicle Coordination by Multi-Critic Policy Gradient Optimization

Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

Neural-Network-Based Adaptive Fault-Tolerant Cooperative Control of Heterogeneous Multiagent Systems With Multiple Faults and DoS Attacks

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments