Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

Path Planning of Autonomous Underwater Vehicle for Optimal Acoustic Tomography

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Strategic Deployment in the Deep: Principled Underwater Sensor Placement Optimization with Three-Dimensional Acoustic Map.

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

Ocean Acoustic Tomography As a Data Assimilation Problem

Sparsity-based Approach for Ocean Acoustic Tomography Using Learned Dictionaries

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

A Multi-AUV Path Planning System Based on the Omni-Directional Sensing Ability

Inversion of Range-Dependent Ocean Environmental Parameters Using Radiation Noises of an Autonomous Underwater Vehicle

Cooperative Coverage Path Planning for AUVs in Integrated Underwater Acoustic Communication and Detection Networks

A Complete Coverage Path Planning Approach for an Autonomous Underwater Helicopter in Unknown Environment Based on VFH+ Algorithm

Numerical Simulation of Time-Optimal Path Planning for Autonomous Underwater Vehicles Using a Markov Decision Process Method

Solution to Long-Range Continuous and Precise Positioning in Deep Ocean for Autonomous Underwater Vehicles Using Acoustic Range Estimation and Inertial Sensor Measurements

Stealth path planning for a high speed torpedo-shaped autonomous underwater vehicle to approach a target ship

Research on Autonomous Underwater Vehicle Path Optimization Using a Field Theory-Guided A* Algorithm

Tracking Control of Autonomous Underwater Vehicles with Acoustic Localization and Extended Kalman Filter

Hierarchical dynamic trajectory planning for autonomous underwater vehicles: Algorithms and experiments

Acoustic-optic assisted multisensor navigation for autonomous underwater vehicles

Navigation in the Presence of Obstacles for an Agile Autonomous Underwater Vehicle