Abstract:The autonomous navigation and obstacle avoidance capabilities of autonomous underwater vehicles (AUVs) are essential for ensuring their safe navigation and long-term, efficient operation. However, the complexity of the marine environment poses significant challenges to safe and effective obstacle avoidance. To address this issue, this study proposes an AUV obstacle avoidance control algorithm based on offline reinforcement learning. This method adopts the Conservative Q-learning (CQL) algorithm, which is based on the Soft Actor-Critic (SAC) framework. It learns from obtained historical obstacle avoidance data and ultimately achieves a favorable obstacle avoidance control strategy. In this method, PID and SAC control algorithms are utilized to generate expert obstacle avoidance data to construct a diversified offline database. Additionally, based on the line-of-sight (LOS) guidance method and artificial potential field (APF) method, information regarding the distance and orientation of targets and obstacles is incorporated into the state space, and heading and obstacle avoidance reward terms are integrated into the reward function design. The algorithm successfully guides the AUV in autonomous navigation and dynamic obstacle avoidance in three-dimensional space. Furthermore, the algorithm exhibits a certain degree of anti-interference capability against uncertain disturbances and ocean currents, enhancing the safety and robustness of the AUV system. Simulation results fully demonstrate the feasibility and effectiveness of the intelligent obstacle avoidance method based on offline reinforcement learning. This study highlights the profound significance of offline reinforcement learning in enabling robust and reliable control systems for AUVs, paving the way for enhanced operational capabilities in challenging marine environments.

Mapping and Obstacle Avoidance Using Multi-Range Sonar for BSA-AUV: Methodology and Lake Trial

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

Integrated Navigation for an Autonomous Underwater Vehicle Carrying Synthetic Aperture Sonar

Shallow-water Wideband Low-Frequency Synthetic Aperture Sonar for an Autonomous Underwater Vehicle

A Novel Unmanned Surface Vehicle with 2D-3D Fused Perception and Obstacle Avoidance Module

Research on Obstacle Detection and Avoidance of Autonomous Underwater Vehicle Based on Forward-Looking Sonar

Research on Real Time Obstacle Avoidance Method for AUV Based on Combination of ViT-DPFN and MPC

A Terrain-Following Control Method for Autonomous Underwater Vehicles with Single-Beam Sensor Configuration

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

A Complete Coverage Path Planning Approach for an Autonomous Underwater Helicopter in Unknown Environment Based on VFH+ Algorithm

An Obstacle Avoidance Strategy for AUV Based on State-Tracking Collision Detection and Improved Artificial Potential Field

A Cooperative Hunting Method for Multi-AUV Swarm in Underwater Weak Information Environment with Obstacles

Multi-AUV coverage path planning algorithm using side-scan sonar for maritime search

Intelligent obstacle avoidance algorithms for autonomous underwater vehicle

Research on obstacle avoidance of underactuated autonomous underwater vehicle based on offline reinforcement learning

Line of Sight Guidance with Intelligent Obstacle Avoidance for Autonomous Underwater Vehicles

AUV Collision Avoidance Strategy Based on Fuzzy Reinforcement Learning

Bio-Inspired Cooperative Control Scheme of Obstacle Avoidance for UUV Swarm

An AUV collision avoidance algorithm in unknown environment with multiple constraints

A fuzzy comprehensive judgment algorithm for obstacle-avoidance of underwater welding robot

High-Speed Obstacle Avoidance of a Large-Scale Underactuated Autonomous Underwater Vehicle under a Finite Field of View