Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

A 3D real-time obstacle avoidance method for an under-actuated AUV

A Real-time Obstacle Avoidance Method for AUV Using a Multibeam Forward Looking Sonar

An AUV fuzzy obstacle avoidance method under event feedback supervision

An Obstacles-avoidance Method of Three-dimensional for AUV Based on Collision Risk

AUV Real-time Dynamic Obstacle Avoidance Strategy Based on Relative Motion

Mapping and Obstacle Avoidance Using Multi-Range Sonar for BSA-AUV: Methodology and Lake Trial

Experiments with obstacle and terrain avoidance of autonomous underwater vehicle

Path Following Based on Waypoints and Real-Time Obstacle Avoidance Control of an Autonomous Underwater Vehicle

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

Dynamic Obstacle Avoidance For Unmanned Underwater Vehicles Based On An Improved Velocity Obstacle Method

Research on Real Time Obstacle Avoidance Method for AUV Based on Combination of ViT-DPFN and MPC

Research on Obstacle Avoidance Planning for UUV Based on A3C Algorithm

Research on Obstacle Avoidance Planning for AUV Based on Forward Looking Sonar

A Three-Dimension Real-Time Obstacle Avoidance Algorithm for Unmanned Surface Vehicle

AUV path tracking with real-time obstacle avoidance via reinforcement learning under adaptive constraints

Intelligent obstacle avoidance algorithms for autonomous underwater vehicle

3D path planning for AUV using fuzzy logic

High-Speed Obstacle Avoidance of a Large-Scale Underactuated Autonomous Underwater Vehicle under a Finite Field of View

Multi-AUV Cooperative Control and Autonomous Obstacle Avoidance Study

OBSTACLE AVOIDANCE OF AUTONOMOUS UNDERWATER VEHICLES BASED ON BALANCE POINT OF MOTION

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning