Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

Research on Method of Collision Avoidance Planning for UUV Based on Deep Reinforcement Learning

AUV Collision Avoidance Planning Method Based on Deep Deterministic Policy Gradient

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

An adaptive dynamic window approach for UUV obstacle avoidance planning in 3D environments

Research on Obstacle Avoidance Planning for UUV Based on A3C Algorithm

Research on collision avoidance algorithm of unmanned surface vehicle based on deep reinforcement learning

AUV Dynamic Obstacle Avoidance Method Based on Improved PPO Algorithm

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

Path Planning of Unmanned Underwater Vehicles Based on Deep Reinforcement Learning Algorithm

Proximal policy optimization with reciprocal velocity obstacle based collision avoidance path planning for multi-unmanned surface vehicles

Research on Dynamic Planning Method for Safe Path of UUV in Complex Fishing Net Deployed Waters

Cooperative Coverage Path Planning for AUVs in Integrated Underwater Acoustic Communication and Detection Networks

Optimal Search Path Planning of UUV in Battlefeld Ambush Scene

Deep reinforcement learning with dynamic window approach based collision avoidance path planning for maritime autonomous surface ships

Real-time Planning and Collision Avoidance Control Method Based on Deep Reinforcement Learning

DRL-based Path Planning and Obstacle Avoidance of Autonomous Underwater Vehicle

Trajectory Planning of UUV-assisted UWOC Systems Based on DQN

Asynchronous Multithreading Reinforcement-Learning-Based Path Planning and Tracking for Unmanned Underwater Vehicle

Research on autonomous planning for AUV in unstructured environment

Real-time Obstacle Avoidance for AUV Based on Reinforcement Learning and Dynamic Window Approach

UUV Path Planning for Collision Avoidance Based on Ant Colony Algorithm