Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

Trajectory Planning for Airborne Radar in Extended Target Tracking Based on Deep Reinforcement Learning

Real-Time Trajectory Planning for Aerial Perching.

Memory-Enhanced Twin Delayed Deep Deterministic Policy Gradient (ME-TD3)-Based Unmanned Combat Aerial Vehicle Trajectory Planning for Avoiding Radar Detection Threats in Dynamic and Unknown Environments

Deep reinforcement learning-based reactive trajectory planning method for UAVs

Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning

Target tracking strategy using deep deterministic policy gradient

Integrated Trajectory Planning and Resource Scheduling for Multiple Target Tracking in Airborne Radar Network

Online Trajectory Planning Method for Midcourse Guidance Phase Based on Deep Reinforcement Learning

Standoff Target Tracking for Networked UAVs with Specified Performance Via Deep Reinforcement Learning

Deep Reinforcement Learning for Target Searching in Cognitive Electronic Warfare

Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

Stealth Aircraft Penetration Trajectory Planning in 3D Complex Dynamic Based on Radar Valley Radius and Turning Maneuver

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Intelligent Dual-UAV Reconnaissance Mission Planning

UAV autonomous path optimization simulation based on radar tracking prediction

Trace Pheromone-Based Energy-Efficient UAV Dynamic Coverage Using Deep Reinforcement Learning

Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints