Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

3D trajectory planning based on the Rapidly-exploring Random Tree–Connect and artificial potential fields method for unmanned aerial vehicles

An Improved Artificial Potential Field Based Path Planning Algorithm for Unmanned Aerial Vehicle in Dynamic Environments

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

3D Path Planning of the Solar Powered UAV in the Urban-mountainous Environment with Multi-objective and Multi-constraint Based on the Enhanced Sparrow Search Algorithm Incorporating the Levy Flight Strategy

UAV Path Planning Based on Improved Artificial Potential Field Method

Online paths planning method for unmanned surface vehicles based on rapidly exploring random tree and a cooperative potential field

Deep reinforcement learning-based reactive trajectory planning method for UAVs

Path Planning with Potential Field-Based Obstacle Avoidance in a 3D Environment by an Unmanned Aerial Vehicle

Hierarchical collision-free trajectory planning for autonomous vehicles based on improved artificial potential field method

Path planning for UAVS based on improved artificial potential field method through changing the repulsive potential function

Research on UAV path planning obstacle avoidance algorithm based on improved artificial potential field method

Three-dimensional Path Planning for Unmanned Aerial Vehicle Based on Interfered Fluid Dynamical System

Research on UAV Path Planning Based on Improved Artificial Potential Field Method

Efficient and High Path Quality Autonomous Exploration and Trajectory Planning of UAV in an Unknown Environment

Local Trajectory Planning for Obstacle Avoidance of Unmanned Tracked Vehicles Based on Artificial Potential Field Method

Three-dimensional path planning for unmanned aerial vehicles based on fluid flow

An improved RRT* drone three-dimensional path-planning algorithm based on point cloud maps

Research on A Global Path-Planning Algorithm for Unmanned Arial Vehicle Swarm in Three-Dimensional Space Based on Theta*–Artificial Potential Field Method

Three-dimensional path planning with enhanced gravitational search algorithm for unmanned aerial vehicle

Path planning of unmanned surface vehicle based on artificial potential field approach considering virtual target points

Reliable Path Planning Algorithm Based on Improved Artificial Potential Field Method