Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

Intelligent AUV Surfacing Control in Network Attack Scenario

Learning an End-To-End Policy for AUV Control Within Just Forty Minutes Using Parallel Simulation

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

AUV Surfacing Control with Adversarial Attack Against DLaaS Framework

AUV Obstacle Avoidance Framework Based on Event-Triggered Reinforcement Learning

Target Search Control Of Auv In Underwater Environment With Deep Reinforcement Learning

A Learning Method for AUV Collision Avoidance Through Deep Reinforcement Learning

Sim-to-Real Transfer of Adaptive Control Parameters for AUV Stabilization under Current Disturbance

Deep reinforcement learning for adaptive path planning and control of an autonomous underwater vehicle

AUV position tracking and trajectory control based on fast-deployed deep reinforcement learning method

Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle

Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning

AUV Path Following Control using Deep Reinforcement Learning Under the Influence of Ocean Currents.

Path-Following Control of Unmanned Underwater Vehicle Based on an Improved TD3 Deep Reinforcement Learning

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

Sim-to-real transfer of adaptive control parameters for AUV stabilisation under current disturbance

Deep Reinforcement Learning for Vectored Thruster Autonomous Underwater Vehicle Control

Secure and Cooperative Target Tracking Via AUV Swarm - A Reinforcement Learning Approach.

Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle

A Fast Adaptive AUV Control Policy Based on Progressive Networks with Context Information

Enhancing Underwater IoT Security: A Collaborative Pursuit Strategy Using Multi-Agent Reinforcement Learning