Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

AUV Local Path Planning Based on Fusion of Improved DWA and RRT Algorithms

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Fusion Algorithm Based on Improved A* and DWA for USV Path Planning

Local Path Planning of Unmanned Underwater Vehicle Based on Improved APF and Rolling Window Method

Research on Path Planning Method of Unmanned Boat Based on Improved DWA Algorithm

Research on Path Planning Algorithm of Driverless Ferry Vehicles Combining Improved A* and DWA

Improved Artificial Potential Field Algorithm Assisted by Multisource Data for AUV Path Planning

Research on formation navigation of USV based on improved A* and DWA fusion algorithm

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

AUV Path Planning Based on Differential Evolution with Environment Prediction

Deep-Sea A+: An Advanced Path Planning Method Integrating Enhanced A and Dynamic Window Approach for Autonomous Underwater Vehicles

Hybrid path planning method for USV using bidirectional A* and improved DWA considering the manoeuvrability and COLREGs

Path Planning for AUVs Based on Improved APF-AC Algorithm

Study of Robot Path Planning with Improved A* And DWA Algorithm Fusion

Research on Path Planning Algorithm Based on Dimensionality Reduction Method and Improved RRT

Robot Path Planning Algorithm based on Improved A* and DWA

Path planning of autonomous underwater vehicle in unknown environment based on improved deep reinforcement learning

Path planning for robotic fish based on improved RRT* algorithm and dynamic window approach

Improved Artificial Potential Field Method Applied for AUV Path Planning