Abstract:Obstacle avoidance planning has always been an essential technology for Autonomous Underwater Vehicles (AUV) underwater operations. In view of the complex underwater obstacle environment, planning a path that takes into account the optimal calculation efficiency and energy consumption is of great significance to underwater operations. The rapidly random tree * (RR$\text{T}^{*}$) method has been proposed in recent years to solve the path optimization problem. Compared with the original rapidly random tree (RRT), RRT * has the feature of gradual optimization of the path, reducing a lot of useless border memory storage, greatly improving the efficiency of search. Since the RR$\text{T}^{*}$ algorithm is essentially a random sampling extension, the following problems will occur: The goal is so weak that the cost of exploring ineffective areas is high. In this paper, the RRT * algorithm driven by reinforcement learning (RL-RR$\text{T}^{*}$) is used to reduce the detection cost of invalid areas. This method uses Q-Learning to optimize the random tree expansion process of RRT * , which not only maintains the random exploratory property of RRT * in unknown special environments, but also uses Q-Learning to reduce the exploration cost of invalid regions. Specifically, while satisfying the AUVs kinematics model, by setting the reward function of the extended node, the variable probability parameter of the biased target and the dynamic step function, the invalid nodes are reduced, the exploration process is accelerated, and the path planning efficiency is improved. In the simulation experiment, this method is used in two unknown special maze environments. The experimental results show the feasibility of the RL-RRT * algorithm and the advantages of efficiency and performance.

Research on Path Planning Algorithm Based on Dimensionality Reduction Method and Improved RRT

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Path Planning for AUVs Based on Improved APF-AC Algorithm

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Research Progress of Path Planning Methods for Autonomous Underwater Vehicle

Improved RRT Algorithm for AUV Target Search in Unknown 3D Environment

Path planning of autonomous underwater vehicle in unknown environment based on improved deep reinforcement learning

Three-Dimensional Path Planning Based on Six-Direction Search Scheme

Efficient Path Planning for AUVs in Unmapped Marine Environments Using a Hybrid Local–global Strategy

Path Planning Technologies for Autonomous Underwater Vehicles-A Review.

A Three-Dimensional Path Planning System for AUV Diving Process Considering Ocean Current and Energy Consumption

AUV Local Path Planning Based on Fusion of Improved DWA and RRT Algorithms

Research on Autonomous Underwater Vehicle Path Optimization Using a Field Theory-Guided A* Algorithm

Autonomous Underwater Vehicle-Manipulator Systems Path Planning with RRTAUVMS Algorithm

A Path-Planning Method Considering Environmental Disturbance Based on VPF-RRT*

A Novel Path Planning Algorithm for Autonomous Underwater Vehicle

Obstacle Avoidance Planning Combining Reinforcement Learning and RRT* Applied to Underwater Operations

Path Planning Method Based on D* lite Algorithm for Unmanned Surface Vehicles in Complex Environments

Recovery Path Planning for Autonomous Underwater Vehicles Using Constrained Bi-RRT*-Smart Algorithms

AUV 3D Path Planning Based on the Improved Hierarchical Deep Q Network

Path planning and tracking for autonomous underwater vehicles