Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

Three-dimensional Path Planning for AUVs in Ocean Currents Environment Based on an Improved Compression Factor Particle Swarm Optimization Algorithm

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Optimal Path Planning of Unmanned Surface Vehicle under Current Environment

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

3D Path Planning for AUV in the Presence of Ocean Currents

Three-Dimensional Path Planning of Deep-Sea Mining Vehicle Based on Improved Particle Swarm Optimization

Path Planning Based on Improved Particle Swarm Optimization for AUVs

AUV path planning in a three-dimensional marine environment based on a novel multiple swarm co-evolutionary algorithm

Three-dimensional path planning for autonomous underwater vehicles based on a whale optimization algorithm

Path Planning Algorithm for Long-Range Autonomous Underwater Vehicles Based on Environmental Features

Three-Dimensional Underwater Path Planning Based on Modified Potential Field Algorithm in Time-Varying Current

Dynamic path planning of a three-dimensional underwater AUV based on an adaptive genetic algorithm

An Improved Quantum-Behaved Particle Swarm Optimization Algorithm Combined with Reinforcement Learning for AUV Path Planning

A Novel Unmanned Surface Vehicle Path-Planning Algorithm Based on A* and Artificial Potential Field in Ocean Currents

AUV Path Planning Based on Differential Evolution with Environment Prediction

Three-Dimensional Path Planning Based on Six-Direction Search Scheme

ACO+PSO+A*: A bi-layer hybrid algorithm for multi-task path planning of an AUV

A Novel Particle Swarm Optimization Algorithm Based on Reinforcement Learning Mechanism for AUV Path Planning

Efficient collision-free path planning for autonomous underwater vehicles in dynamic environments with a hybrid optimization algorithm

A novel reinforcement learning based tuna swarm optimization algorithm for autonomous underwater vehicle path planning