Abstract:In a complex underwater environment, finding a viable, collision-free path for an autonomous underwater vehicle (AUV) is a challenging task. The purpose of this paper is to establish a safe, real-time, and robust method of collision avoidance that improves the autonomy of AUVs. We propose a method based on active sonar, which utilizes a deep reinforcement learning algorithm to learn the processed sonar information to navigate the AUV in an uncertain environment. We compare the performance of double deep Q-network algorithms with that of a genetic algorithm and deep learning. We propose a line-of-sight guidance method to mitigate abrupt changes in the yaw direction and smooth the heading changes when the AUV switches trajectory. The different experimental results show that the double deep Q-network algorithms ensure excellent collision avoidance performance. The effectiveness of the algorithm proposed in this paper was verified in three environments: random static, mixed static, and complex dynamic. The results show that the proposed algorithm has significant advantages over other algorithms in terms of success rate, collision avoidance performance, and generalization ability. The double deep Q-network algorithm proposed in this paper is superior to the genetic algorithm and deep learning in terms of the running time, total path, performance in avoiding collisions with moving obstacles, and planning time for each step. After the algorithm is trained in a simulated environment, it can still perform online learning according to the information of the environment after deployment and adjust the weight of the network in real-time. These results demonstrate that the proposed approach has significant potential for practical applications.

Deep Reinforcement Learning-based Multi-AUV Task Allocation Algorithm in Underwater Wireless Sensor Networks

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

Multi-AUV Collaborative Data Collection Algorithm Based on Q-Learning in Underwater Acoustic Sensor Networks

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Multi-AUV Cooperative Localization in Adaptive Sampling for Marine Environmental Monitoring

Task Allocation of Multiple AUVs and Simulation in Large Range Underwater Environment

Multi-AUV dynamic trajectory optimization and collaborative search combined with task urgency and energy consumption scheduling in 3-D underwater environment with random ocean currents and uncertain obstacles

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

The Unified Task Assignment for Underwater Data Collection with Multi-AUV System: A Reinforced Self-Organizing Mapping Approach.

Efficient Data Collection Scheme for Multi-Modal Underwater Sensor Networks Based on Deep Reinforcement Learning

A Multi-AUV Collaborative Ocean Data Collection Method Based on LG-DQN and Data Value

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

Multi-Auv Collaborative Data Collection in Integrated Underwater Acoustic Communication and Detection Networks

Dynamic Task Assignment for Multi-AUV Cooperative Hunting

Noisy Dueling Double Deep Q-Network algorithm for autonomous underwater vehicle path planning

Dynamic Task Assignment and Path Planning for Multi-AUV System in Variable Ocean Current Environment

Multi-AUV Kinematic Task Assignment based on Self-organizing Map Neural Network and Dubins Path Generator

Correction Redistribution Mechanism Based on Forward-Reverse Solutions and Real-Time Path Dynamic Adaptive Re-Planning for Multi-AUVs Collaborative Search

District Partition-Based Data Collection Algorithm with Event Dynamic Competition in Underwater Acoustic Sensor Networks