Abstract:Obstacle avoidance planning has always been an essential technology for Autonomous Underwater Vehicles (AUV) underwater operations. In view of the complex underwater obstacle environment, planning a path that takes into account the optimal calculation efficiency and energy consumption is of great significance to underwater operations. The rapidly random tree * (RR$\text{T}^{*}$) method has been proposed in recent years to solve the path optimization problem. Compared with the original rapidly random tree (RRT), RRT * has the feature of gradual optimization of the path, reducing a lot of useless border memory storage, greatly improving the efficiency of search. Since the RR$\text{T}^{*}$ algorithm is essentially a random sampling extension, the following problems will occur: The goal is so weak that the cost of exploring ineffective areas is high. In this paper, the RRT * algorithm driven by reinforcement learning (RL-RR$\text{T}^{*}$) is used to reduce the detection cost of invalid areas. This method uses Q-Learning to optimize the random tree expansion process of RRT * , which not only maintains the random exploratory property of RRT * in unknown special environments, but also uses Q-Learning to reduce the exploration cost of invalid regions. Specifically, while satisfying the AUVs kinematics model, by setting the reward function of the extended node, the variable probability parameter of the biased target and the dynamic step function, the invalid nodes are reduced, the exploration process is accelerated, and the path planning efficiency is improved. In the simulation experiment, this method is used in two unknown special maze environments. The experimental results show the feasibility of the RL-RRT * algorithm and the advantages of efficiency and performance.

Application of Improved RRT Algorithm in Unmanned Surface Vehicle Path Planning

Path Planning of Unmanned Surface Vessel Based on Improved RRT*

Research on Unmanned Ship Path Planning Based on RRT Algorithm

Unmanned Surface Vehicle Path Planning Based on Improved Informed-RRT* Algorithm

Unmanned Ship Path Planning Based on RRT

Research on Unmanned Ship Path Planning Algorithm Based on RRT* and Artificial Potential Field Method

Path planning of UAV based on the improved rapidly-exploring random tree algorithm

Inland Waterway Ship Path Planning Based on Improved RRT Algorithm

Path Planning Method for Unmanned Surface Vehicle Based on RRT* and DWA

Improved RRT Algorithm for AUV Target Search in Unknown 3D Environment

A Path-Planning Method Considering Environmental Disturbance Based on VPF-RRT*

Obstacle Avoidance Planning Combining Reinforcement Learning and RRT* Applied to Underwater Operations

Autonomous Underwater Vehicle-Manipulator Systems Path Planning with RRTAUVMS Algorithm

Automatic Collision Avoidance Algorithm for Unmanned Surface Vessel Based on Improved Bi-RRT Algorithm

Research on Intelligent Ship Route Planning Based on the Adaptive Step Size Informed-RRT* Algorithm

Research Status and Development Trend of Path Planning Algorithm for Unmanned Vehicles

Path Optimization of AUV Based on Smooth-Rrt Algorithm

Safety-Critical Path Planning of Autonomous Surface Vehicles Based on Rapidly-Exploring Random Tree Algorithm and High Order Control Barrier Functions

Research on Path Planning Algorithm Based on Dimensionality Reduction Method and Improved RRT

AUV Path Planning Based on Improved RRT and Bezier Curve Optimization

Multi-target UAV path planning based on improved RRT algorithm