Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

Feedback RRT* algorithm for UAV path planning in a hostile environment

FC-RRT*: An Improved Path Planning Algorithm for UAV in 3D Complex Environment

UAV trajectory planning in cluttered environments based on PF-RRT* algorithm with goal-biased strategy

Bidirectional Homotopy-Guided RRT for Path Planning

Unmanned Aerial Vehicle Path-Planning Method Based on Improved P-RRT* Algorithm

Obstacle Avoidance Path Planning for UAV Based on Improved RRT Algorithm

Potential-Field-RRT: A Path-Planning Algorithm for UAVs Based on Potential-Field-Oriented Greedy Strategy to Extend Random Tree

An improved RRT* drone three-dimensional path-planning algorithm based on point cloud maps

A Probabilistically Robust Path Planning Algorithm for UAVs Using Rapidly-Exploring Random Trees

Multi-target UAV path planning based on improved RRT algorithm

Obstacle Avoidance and Path Planning for UGVs Using Improved RRT Algorithm

An Adaptive Bidirectional Quick Optimal Rapidly-exploring Random Tree Algorithm for Path Planning

UAV trajectory planning based on bi-directional APF-RRT* algorithm with goal-biased

Mixed population RRT algorithm for UAV path planning

RRT* Algorithm under Holonomic Conditions for UAVs

Efficient and High Path Quality Autonomous Exploration and Trajectory Planning of UAV in an Unknown Environment

A Disaster Relief UAV Path Planning Based on APF-IRRT* Fusion Algorithm

Research, Analysis, and Improvement of Unmanned Aerial Vehicle Path Planning Algorithms in Urban Ultra-Low Altitude Airspace

A method of feasible trajectory planning for UAV formation based on bi-directional fast search tree

UAVs Path Planning Based on Combination of Rapidly Exploring Random Tree and Rauch-Tung-Striebel Filter

Deep reinforcement learning-based reactive trajectory planning method for UAVs