Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

Early Warning Obstacle Avoidance-Enabled Path Planning for Multi-AUV-Based Maritime Transportation Systems

A Path Planning Scheme for AUV Flock-Based Internet-of-Underwater-Things Systems to Enable Transparent and Smart Ocean

Proactive Alarming-enabled Path Planning for Multi-AUV-based Underwater IoT Systems

A Heterogeneous Network with Multiple Routing Protocols for Autonomous Underwater Vehicles

Cooperative Coverage Path Planning for AUVs in Integrated Underwater Acoustic Communication and Detection Networks

An SDN Architecture for AUV-Based Underwater Wireless Networks to Enable Cooperative Underwater Search

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

SDMA - A SDN-based Architecture of Multi-modal AUVs Network.

A Scheme for Cooperative-Escort Multi-Submersible Intelligent Transportation System Based on SDN-Enabled Underwater IoV

A Time-Saving Path Planning Scheme for Autonomous Underwater Vehicles with Complex Underwater Conditions

Energy-Efficient Multiple Autonomous Underwater Vehicle Path Planning Scheme in Underwater Sensor Networks

Online Collaborative Obstacle Avoidance Path Planning Based on Multi-AUV

Multi-Auv Collaborative Data Collection in Integrated Underwater Acoustic Communication and Detection Networks

Path Planning for Multiple USV Collecting Seabed-based Data Based on UWA Communication

Multi-AUV Collaborative Data Collection Scheme to Clustering and Routing for Heterogeneous UWSNs

Obstacle-avoiding Path Planning for Multiple Autonomous Underwater Vehicles with Simultaneous Arrival

An Auv-Aided Routing Protocol Based on Dynamic Gateway Nodes for Underwater Wireless Sensor Networks

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

A Multi-AUV Path Planning System Based on the Omni-Directional Sensing Ability

A Multi-Controllers Architecture for Software-Defined Underwater Acoustic Sensor Networks