Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

Unmanned Surface Vehicle Aided Maritime Data Collection Using Deep Reinforcement Learning

USV Aided Reliable and Efficient Data Collection in Maritime Monitoring System

Dynamic Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller

Unmanned Surface Vessel Motion Intention Recognition Based on Deep Reinforcement Learning

Using Deep Reinforcement Learning Methods for Autonomous Vessels in 2D Environments

A novel intelligent collision avoidance algorithm based on deep reinforcement learning approach for USV

Model-based Deep Reinforcement Learning for Data-Driven Motion Control of an Under-Actuated Unmanned Surface Vehicle: Path Following and Trajectory Tracking

Research on Unmanned Surface Vehicle Collision Avoidance Based on Deep Reinforcement Learning

Research on collision avoidance algorithm of unmanned surface vehicle based on deep reinforcement learning

Adaptive Data Collection and Offloading in Multi-UAV-Assisted Maritime IoT Systems: A Deep Reinforcement Learning Approach

Dynamic Navigation and Area Assignment of Multiple USVs Based on Multi-Agent Deep Reinforcement Learning

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

Obstacle avoidance USV in multi-static obstacle environments based on a deep reinforcement learning approach

Collision-avoidance under COLREGS for Unmanned Surface Vehicles Via Deep Reinforcement Learning

Multi-Auv Collaborative Data Collection in Integrated Underwater Acoustic Communication and Detection Networks

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Efficient Data Collection Scheme for Multi-Modal Underwater Sensor Networks Based on Deep Reinforcement Learning

Data harvesting in uncharted waters: Interactive learning empowered path planning for USV-assisted maritime data collection under fully unknown environments

Distributed Information Fusion Based Trajectory Tracking for USV and UAV Clusters Via Multi-Agent Deep Learning Approach

A path planning approach for unmanned surface vehicles based on dynamic and fast Q-learning

Local path planning for unmanned surface vehicle based on spatial and temporal sensing-enhanced deep Q-network