Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

Simulation for Path Planning of OUC-II Glider with Intelligence Algorithm

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Deep reinforcement learning-based path planning method for underwater gliders in unknown 3D marine environment

An Approach to Multi-Objective Path Planning Optimization for Underwater Gliders

Underwater glider 3D path planning with adaptive segments and optimal motion parameters based on improved JADE algorithm

Multidisciplinary optimization-based path planning for underwater gliders executing multi-point exploration missions

Path planning for underwater gliders in time-varying ocean current using deep reinforcement learning

Gliding strategy analysis and optimisation of underwater gliders balancing energy consumption, motion accuracy and voyage velocity

Ant-Colony-Based Complete-Coverage Path-Planning Algorithm for Underwater Gliders in Ocean Areas With Thermoclines

A meta-heuristic assisted underwater glider path planning method

Optimal Path Planning of Unmanned Surface Vehicle under Current Environment

AUV path planning in a three-dimensional marine environment based on a novel multiple swarm co-evolutionary algorithm

An Optimal-Path-Planning Method for Unmanned Surface Vehicles Based on a Novel Group Intelligence Algorithm

Optimal search path planning for unmanned surface vehicle based on an improved genetic algorithm

GA-based Path Planning for Multiple AUVs

A novel reinforcement learning based tuna swarm optimization algorithm for autonomous underwater vehicle path planning

Multi-Underwater Gliders Coverage Path Planning Based on Ant Colony Optimization

Path Planning Method for Multi-point Exploration of Underwater Glider to Minimize Energy Consumption

Bio-inspired Neural Network-based Optimal Path Planning for UUVs under the Effect of Ocean Currents

Improved Genetic Algorithm Based on Oscillation Factor to Solve the AUV Path Planning Problem

Path Planning for Autonomous Underwater Vehicles: An Ant Colony Algorithm Incorporating Alarm Pheromone