Abstract:Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Ahead of Print. In order to improve the ability of avoiding dynamic threats during the flight of unmanned aerial vehicles (UAVs), a deep reinforcement learning-based reactive trajectory planning method is proposed in this paper. Firstly, a constrained Rapidly-exploring Random Tree-Connect algorithm (C-RRT-Connect) is proposed as the basic algorithm of reactive trajectory planning to globally plan for avoiding static obstacles in the environment. The C-RRT-Connect algorithm introduces the idea of target attraction to constrain the optimal growth point in the RRT-Connect algorithm. Then, based on the global trajectory, the local optimization is carried out according to the dynamic threats detected by the UAV during the flight. According to the real-time relative state between the UAV and the detected dynamic threat, the reaction sampling points and directional coefficients for avoiding the corresponding dynamic threat are generated online via the action network trained with the depth deterministic policy gradient algorithm (DDPG). And then the local trajectory is adjusted to modify the flight trajectory of the UAV to achieve reactive obstacle avoidance. The simulation experiment firstly compares the global trajectory planning performance of C-RRT-Connect and RRT-Connect in static environment, and secondly compares the local trajectory planning performance of DDPG algorithm and the artificial potential field method in dynamic environment. The experimental results show that in static environment, C-RRT-Connect algorithm has faster searching speed, less invalid samples and higher searching trajectory quality than RRT-Connect algorithm; In a dynamic environment, DDPG algorithm reduces the average running time by about 26% compared with the artificial potential field method, and has a stronger ability to evade dynamic threats in real time.

Fast Reactive Mechanism for Desired Trajectory Attacks on Unmanned Aerial Vehicles

An Enhanced UAV Safety Control Scheme Against Attacks on Desired Trajectory

On trackability of a moving target by fixed-wing UAV using geometric approach

Adaptive Event-Based Tracking Control of Unmanned Marine Vehicle Systems with DoS Attack

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Improving Physical Layer Security for Multi-Uav Systems Against Hybrid Wireless Attacks

Data‐driven adaptive trajectory tracking control of unmanned marine vehicles under disturbances and DoS attacks

Stealthy Perception-based Attacks on Unmanned Aerial Vehicles

A Safety Constrained Control Framework for UAVs in GPS Denied Environment

Autonomous control of UAV trajectory based on RHC-Radau method in complex penetration combat environment

Event‐triggered adaptive output feedback control of unmanned aerial vehicles under hybrid attacks

Distributed Prescribe Performance Control Based on Adaptive Neural Network Strategy for Multi-UAVs under Cyber-Attacks

Resilient Distributed Fixed-Time Tracking of Heterogeneous UAVs-UGVs Systems Against DoS Attacks

Deep reinforcement learning-based reactive trajectory planning method for UAVs

Saturated Threshold Event-Triggered Control for Multiagent Systems Under Sensor Attacks and Its Application to UAVs

A Novel Robust Finite-time Stable Trajectory Tracking Scheme for Fixed Wing Unmanned Aerial Vehicles

Towards Zonotopic Replay Attack Detection for Unmanned Surface Vehicles

Fast-Tracker: A Robust Aerial System for Tracking Agile Target in Cluttered Environments

Research on Trajectory Tracking Control of Inspection UAV Based on Real-Time Sensor Data

Requiem for a drone: a machine-learning based framework for stealthy attacks against unmanned autonomous vehicles

Network-Based Adaptive Multievent-Triggered Fuzzy Dynamic Positioning Controller Design for Unmanned Surface Vehicles Against Denial-of-Service Attacks