Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

A New Path Following Method of AUV Using Line-of-sight with Sideway

A Path Following Control Method for Underactuated Unmanned Surface Vehicles Based on Output Redefinition

Path Following of Autonomous Surface Vehicles with Line-of-sight and Nonlinear Model Predictive Control

Improved Line-of-sight Nonlinear Trajectory Tracking Control of Autonomous Underwater Vehicle Exposed to High Variable Speed Ocean Currents

Path Following Control with Sideslip Reduction for Underactuated Unmanned Surface Vehicles

An Underactuated AUV Tracking Algorithm Based on Backstepping Adaptive Sliding Mode Control

Integrated Navigation for an Autonomous Underwater Vehicle Carrying Synthetic Aperture Sonar

Obstacle Avoidance Strategy with Path-following for USV Based on Obstacle-guidance Model Using 2D-Lidar in Urban River Conditions

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Improved Indirect Adaptive Line-of-Sight Guidance Law for Path Following of Under-Actuated Auv Subject to Big Ocean Currents

Three‐dimensional path following control of underactuated autonomous underwater vehicles with nonzero roll dynamics: A novel line‐of‐sight‐guided approach

Path Following Based on Waypoints and Real-Time Obstacle Avoidance Control of an Autonomous Underwater Vehicle

An Improved ELOS Guidance Law for Path Following of Underactuated Unmanned Surface Vehicles

Distributed Path-Following Formation Control of Multi-AUV Based on Graph Laplacian

A Control Method for Path Following of AUVs Considering Multiple Factors Under Ocean Currents

Adaptive Line-Of-Sight guidance law based on vector fields path following for underactuated unmanned surface vehicle

Advances in Line-of-Sight Guidance for Path Following of Autonomous Marine Vehicles: An Overview

An Improved ESO-Based Line-of-Sight Guidance Law for Path Following of Underactuated Autonomous Underwater Helicopter With Nonlinear Tracking Differentiator and Anti-saturation Controller

Path Following Model Predictive Control of a Coupled Autonomous Underwater Vehicle

A Balanced Path-Following Approach to Course Change and Original Course Convergence for Autonomous Vessels

Path Following Method for AUV Based on Q-Learning and RBF Neural Network