Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

Partition and planning: A human-like motion decision for UAV in trap environment

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

DPMPC-Planner: A real-time UAV trajectory planning framework for complex static environments with dynamic obstacles

A Vision-based UAV Tracker Aiming at Aerial Targets

An Improved Artificial Potential Field Based Path Planning Algorithm for Unmanned Aerial Vehicle in Dynamic Environments

Implementation of Trapped Personnel Detection and Evacuation Guidance in Indoor Fire Scene Based on Quadrotor Uav

Safe Maneuvering Planning for Flights in Complex Environments

Position Checking-Based Sampling Approach Combined with Attraction Point Local Optimization for Safe Flight of UAVs

Bi-level intelligent dynamic path planning for an UAV in low-altitude complex urban environment

EF-TTOA: Development of a UAV Path Planner and Obstacle Avoidance Control Framework for Static and Moving Obstacles

Efficient and High Path Quality Autonomous Exploration and Trajectory Planning of UAV in an Unknown Environment

A new method for unmanned aerial vehicle path planning in complex environments

A Fast Planning Approach for 3D Short Trajectory with a Parallel Framework

Dynamic Path Planning of the UAV Avoiding Static and Moving Obstacles

Online environmentally adaptive trajectory planning for rotorcraft unmanned aerial vehicles

A Dynamic Trajectory Planning Algorithm for Urban Ultra-Low Altitude UAVs Based on a Fusion Heuristic Algorithm

Intelligent Path Planning and Following for UAVs in Forest Surveillance and Fire Fighting Missions

UAV Motion Strategies in Uncertain Dynamic Environments: A Path Planning Method Based on Q-Learning Strategy

Deep reinforcement learning-based reactive trajectory planning method for UAVs

Autonomous localized path planning algorithm for UAVs based on TD3 strategy