Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

Study of Local Path Planning Based on Forward Looking Sonar for AUV

Research on Obstacle Avoidance Planning for AUV Based on Forward Looking Sonar

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Underwater vehicle local path planning based on sonar image processing

Research on autonomous planning for AUV in unstructured environment

Auv Local Path Planning Based on Acoustic Image Processing

Local path planning for unmanned surface vehicle based on spatial and temporal sensing-enhanced deep Q-network

AUV Path Planning with Kinematic Constraints in Unknown Environment Using Reinforcement Learning.

Local Path Planning Method for AUV Based on Fuzzy-neural Network

Local Planning Method of Autonomous Underwater Vehicle

AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning

Multi-AUV coverage path planning algorithm using side-scan sonar for maritime search

Local Path Planning and Path Following Control for Inland Water USV

AUV Global Security Path Planning Based on a Potential Field Bio-Inspired Neural Network in Underwater Environment

Path Planning and Obstacle Avoidance for AUV: A Review

Path planning and tracking for AUV in large-scale environment

Implementation of AUV local planning in strong sea flow field based on Q-learning

Dynamic Path Planning for Underwater Vehicles Based on Modified Artificial Potential Field Method

Local Path Planning of Unmanned Underwater Vehicle Based on Improved APF and Rolling Window Method

Path Planning of AUV Based on Digital Charts