Abstract:Path planning has a wide range of applications in many fields of engineering. One of the widely used approaches to solve this problem is sampling-based algorithms. However, a significant limitation of these algorithms is their inability to function effectively in the presence of unknown obstacles within the environment. A feasible way of addressing this issue is by using reinforcement learning to interact with the environment. In the context of path planning, safety means choosing safe and non-optimal paths over the optimal ones and having as few collisions as possible during both the training phase and the test phase. In this paper, a novel two-stage algorithm called R3T*-MOSafeRL( ) is proposed capable of path planning safely in an environment with unknown dynamic obstacles. In the first stage, the Roadmap Multi-Tree RRT* (R3T*) algorithm is presented which uses an initial map of the environment and an expert's information regarding the important regions of the environment to generate a roadmap. The roadmap acts as discretization of the continuous environment to practically deploy tabular reinforcement learning algorithms on top of it. In the next stage, the algorithm uses a novel eligibility trace-based multi-objective safe reinforcement learning (MOSafeRL( )) to perform safe path planning on the roadmap generated by R3T*. Moreover, a heatmap algorithm based on the roadmap and the weights learned by MOSafeRL( ) is presented which provides an interpretable method to gain information about the regions of the map with high activity of the unknown dynamic obstacles. Hence, the proposed algorithm provides a powerful method for path planning in unknown dynamic environments. Finally, to illustrate the efficiency of the proposed algorithm and to verify it, some case studies are considered and the computational results are compared and discussed.

MOD-RRT*: A Sampling-Based Algorithm for Robot Path Planning in Dynamic Environment

Bi-HS-RRT ^X : an Efficient Sampling-Based Motion Planning Algorithm for Unknown Dynamic Environments

RBI-RRT*: Efficient Sampling-Based Path Planning for High-Dimensional State Space

Path Planning in Dynamic Environments Based on the Improved Rapidly-exploring Random Tree and Dynamic Window Approach

Asymptotical RRT-Based Path Planning for Mobile Robots in Dynamic Environments

Bi-AM-RRT*: A Fast and Efficient Sampling-Based Motion Planning Algorithm in Dynamic Environments

AM-RRT*: an Automatic Robot Motion Planning Algorithm Based on RRT

A Method on Dynamic Path Planning for Robotic Manipulator Autonomous Obstacle Avoidance Based on an Improved RRT Algorithm

Path Planning of a Mobile Robot Based on the Improved RRT Algorithm

PQ-RRT*: An improved path planning algorithm for mobile robots

An Improved Rapidly-exploring Random Tree Star Algorithm for Manipulator Path Planning

An Improved RRT* Algorithm for Mobile Robots Path Planning

AM-RRT*: Informed Sampling-based Planning with Assisting Metric

Extended RRT-based Path Planning for Flying Robots in Complex 3D Environments with Narrow Passages

Improved RRT-Connect Based Path Planning Algorithm for Mobile Robots

R3T*-MOSafeRL( ): path planning of mobile robots in unknown dynamic environments

DR-Informed-RRT* Algorithm: Efficient Path Planning for Quadruped Robots in Complex Environments.

An Adaptive Multi-Rrt Approach for Robot Motion Planning

HNSRRT*:A Path Planning Algorithm Based On Heuristic Non-Uniform Sampling Method In Complex Obstacle Environment

Tropistic RRT*: An Efficient Planning Algorithm via Adaptive Restricted Sampling Space