Abstract:Obstacle avoidance planning has always been an essential technology for Autonomous Underwater Vehicles (AUV) underwater operations. In view of the complex underwater obstacle environment, planning a path that takes into account the optimal calculation efficiency and energy consumption is of great significance to underwater operations. The rapidly random tree * (RR$\text{T}^{*}$) method has been proposed in recent years to solve the path optimization problem. Compared with the original rapidly random tree (RRT), RRT * has the feature of gradual optimization of the path, reducing a lot of useless border memory storage, greatly improving the efficiency of search. Since the RR$\text{T}^{*}$ algorithm is essentially a random sampling extension, the following problems will occur: The goal is so weak that the cost of exploring ineffective areas is high. In this paper, the RRT * algorithm driven by reinforcement learning (RL-RR$\text{T}^{*}$) is used to reduce the detection cost of invalid areas. This method uses Q-Learning to optimize the random tree expansion process of RRT * , which not only maintains the random exploratory property of RRT * in unknown special environments, but also uses Q-Learning to reduce the exploration cost of invalid regions. Specifically, while satisfying the AUVs kinematics model, by setting the reward function of the extended node, the variable probability parameter of the biased target and the dynamic step function, the invalid nodes are reduced, the exploration process is accelerated, and the path planning efficiency is improved. In the simulation experiment, this method is used in two unknown special maze environments. The experimental results show the feasibility of the RL-RRT * algorithm and the advantages of efficiency and performance.

Smooth Path Planning under Maximum Curvature Constraints for Autonomous Underwater Vehicles Based on Rapidly-Exploring Random Tree Star with B-spline Curves

Autonomous Trajectory Planning Based on Bézier Curve with Curvature Constraints and Piecewise-Jerk Speed-Time Optimization

Path Planning for Autonomous Underwater Vehicle Docking in Stationary Obstacle Environment

Bidirectional Homotopy-Guided RRT for Path Planning

A continuous RRT*-based path planning method for non-holonomic mobile robots using B-spline curves

Recovery Path Planning for Autonomous Underwater Vehicles Using Constrained Bi-RRT*-Smart Algorithms

Composite Astar and B-spline Algorithm for Path Planning of Autonomous Underwater Vehicle

Goal-Biased Rapidly-Exploring Random Trees for Efficient Marine Path Planning

An efficient RRT-based motion planning algorithm for autonomous underwater vehicles under cylindrical sampling constraints

RDT-RRT: Real-time double-tree rapidly-exploring random tree path planning for autonomous vehicles

Obstacle Avoidance Planning Combining Reinforcement Learning and RRT* Applied to Underwater Operations

Online planning for relative optimal and safe paths for USVs using a dual sampling domain reduction-based RRT* method

Curvature Aware Motion Planning with Closed-Loop Rapidly-exploring Random Trees

Escape Path Planning for Unmanned Surface Vehicle Based on Blind Navigation Rapidly Exploring Random Tree* Fusion Algorithm

Local Path Planning for Unmanned Surface Vehicles Based on Hybrid A* and B-spline

Efficient Path Planning for AUVs in Unmapped Marine Environments Using a Hybrid Local–global Strategy

An Adaptive Bidirectional Quick Optimal Rapidly-exploring Random Tree Algorithm for Path Planning

Path Planning Based on Improved RRT Algorithm

Improved RRT* Path-Planning Algorithm Based on the Clothoid Curve for a Mobile Robot Under Kinematic Constraints

Research on Path Planning Algorithm of Autonomous Vehicles Based on Improved RRT Algorithm

Autonomous Underwater Vehicle-Manipulator Systems Path Planning with RRTAUVMS Algorithm