Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

Reactive Obstacle Avoidance Method for a UAV

Reactive Obstacle Avoidance for Unmanned Helicopter Using Fuzzy Control

End-to-End Learning-Based Obstacle Avoidance for Fixed-Wing UAVs

A Modified Q-learning Algorithm Facing for Path Planning and Obstacle Avoidance Method for Unmanned Aerial Vehicle

Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

An Avoiding Obstacles Method Of Multi-Rotor Uavs

A Saliency-Based Reinforcement Learning Approach for a UAV to Avoid Flying Obstacles

RHSOA: Receding Horizon Optimization-Based Swift Obstacle Avoidance Approach for UAVs in Unknown Environments

A Study on Path Planning Algorithms of UAV Collision Avoidance

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

Path Planning for Fixed-Wing UAVs Based on Expert Knowledge and Improved VFH in Cluttered Environments

Real-time Obstacle Avoidance with Deep Reinforcement Learning Three-Dimensional Autonomous Obstacle Avoidance for UAV

A Learning-Based Flexible Autonomous Motion Control Method for UAV in Dynamic Unknown Environments

Q Learning Algorithm Based UAV Path Learning and Obstacle Avoidence Approach

Vision-Based Behavior for Uav Reactive Avoidance by Using A Reinforcement Learning Method

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

Reactive Navigation of an Unmanned Aerial Vehicle with Perception-based Obstacle Avoidance Constraints

Deep reinforcement learning-based reactive trajectory planning method for UAVs

The Algorithm for UAV Obstacle Avoidance and Route Planning Based on Reinforcement Learning

Intelligent Decision-Making for 3-Dimensional Dynamic Obstacle Avoidance of UAV Based on Deep Reinforcement Learning

Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs