Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

A Rapid Planning Repair Method of Three-Dimensional Path for AUV

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Research on Path Planning Algorithm Based on Dimensionality Reduction Method and Improved RRT

A Path-Planning Method Considering Environmental Disturbance Based on VPF-RRT*

Efficient Path Planning for AUVs in Unmapped Marine Environments Using a Hybrid Local–global Strategy

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

AUV Local Path Planning Based on Fusion of Improved DWA and RRT Algorithms

Path Planning Method for Unmanned Surface Vehicle Based on RRT* and DWA

Recovery Path Planning for Autonomous Underwater Vehicles Using Constrained Bi-RRT*-Smart Algorithms

Improved RRT Algorithm for AUV Target Search in Unknown 3D Environment

Obstacle Avoidance Planning Combining Reinforcement Learning and RRT* Applied to Underwater Operations

Feedback-Dubins-RRT Recovery Path Planning of UUV in an Underwater Obstacle Environment

Online planning for relative optimal and safe paths for USVs using a dual sampling domain reduction-based RRT* method

Rapid global path planning algorithm for unmanned surface vehicles in large-scale and multi-island marine environments

Autonomous Underwater Vehicle-Manipulator Systems Path Planning with RRTAUVMS Algorithm

Path Planning Technologies for USV Formation Based on Improved RRT

An Adaptive Bidirectional Quick Optimal Rapidly-exploring Random Tree Algorithm for Path Planning

RSP-UV: Real-time sampling-based path planning method for unmanned vehicles

Escape Path Planning for Unmanned Surface Vehicle Based on Blind Navigation Rapidly Exploring Random Tree* Fusion Algorithm

An Efficient Obstacle Avoidance Approach for USV Considering the Heading Angle Constraint

Three-Dimensional Path Planning for Unmanned Aerial Vehicles Based on the Developed RRT Algorithm