Abstract:Autonomous underwater vehicles (AUVs) are widely used in sampling on-site the seawater parameters, such as temperature, salinity and biomass for better understanding the ocean. The AUV path needs to be carefully planned in order to maximize the sampled information within the power constraints, which is known as the informative path planning (IPP). The existence of ocean currents further complicates the problem. This article proposes an IPP method for AUVs under the influence of ocean currents via combining the probabilistic roadmap and $Q$ -learning. Specifically, the $Q$ -learning algorithm builds an informative optimal AUV path by traversing a learned and updated $Q$ -table. The $Q$ -value in the table represents the expectation of the obtained reward if taking a certain action moving from one position to another. Considering the characteristics of the IPP task, we design the reward matrix in $Q$ -learning using the prior knowledge on the environment information. A convergent $Q$ -table guarantees that only one complete training and learning is required to generate the path between any two positions. This feature facilitates converting the possible repetitive path plannings into simple search problems, and thus the automatic return is easily realized whenever the AUV residual energy is insufficient. Moreover, to improve the efficiency of the $Q$ -learning algorithm, a probabilistic roadmap with random sampling is generated and combined with the $Q$ -learning. Various simulations and comparisons are carried out. The results demonstrate the effectiveness of the proposed IPP algorithm, showing that the convergence of the path planning can be achieved quickly and successfully. The superiority in terms of efficient return path planning over the traditional path planning method, RRT*, is also demonstrated.

Data harvesting in uncharted waters: Interactive learning empowered path planning for USV-assisted maritime data collection under fully unknown environments

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

Optimal Path Planning of Unmanned Surface Vehicle under Current Environment

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

Physical Consistent Path Planning for Unmanned Surface Vehicles under Complex Marine Environment

Achieving optimal-dynamic path planning for unmanned surface vehicles: A rational multi-objective approach and a sensory-vector re-planner

A path planning approach for unmanned surface vehicles based on dynamic and fast Q-learning

Unmanned Surface Vehicle Aided Maritime Data Collection Using Deep Reinforcement Learning

A new real‐time path planning for USV based on dynamic artificial potential field in complex environments

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

An Optimal-Path-Planning Method for Unmanned Surface Vehicles Based on a Novel Group Intelligence Algorithm

Unlocking the Ocean 6G: A Review of Path-Planning Techniques for Maritime Data Harvesting Assisted by Autonomous Marine Vehicles

An Information-Assisted Deep Reinforcement Learning Path Planning Scheme for Dynamic and Unknown Underwater Environment

Path Planning for Unmanned Surface Vehicles Based on Modified Artificial Fish Swarm Algorithm with Local Optimizer

Global path planning and waypoint following for heterogeneous unmanned surface vehicles assisting inland water monitoring

Global-local hierarchical path planning scheme for unmanned surface vehicles under dynamically unforeseen environments

Path Planning Method Based on D* lite Algorithm for Unmanned Surface Vehicles in Complex Environments

Heuristic Surface Path Planning Method for AMV-Assisted Internet of Underwater Things

Artificial intelligence algorithms in unmanned surface vessel task assignment and path planning: A survey

Environment- and Energy-Aware AUV-Assisted Data Collection for the Internet of Underwater Things