Abstract:Unmanned Aerial Vehicles (UAVs) play a vital role in military warfare. In a variety of battlefield mission scenarios, UAVs are required to safely fly to designated locations without human intervention. Therefore, finding a suitable method to solve the UAV Autonomous Motion Planning (AMP) problem can improve the success rate of UAV missions to a certain extent. In recent years, many studies have used Deep Reinforcement Learning (DRL) methods to address the AMP problem and have achieved good results. From the perspective of sampling, this paper designs a sampling method with double-screening, combines it with the Deep Deterministic Policy Gradient (DDPG) algorithm, and proposes the Relevant Experience Learning-DDPG (REL-DDPG) algorithm. The REL-DDPG algorithm uses a Prioritized Experience Replay (PER) mechanism to break the correlation of continuous experiences in the experience pool, finds the experiences most similar to the current state to learn according to the theory in human education, and expands the influence of the learning process on action selection at the current state. All experiments are applied in a complex unknown simulation environment constructed based on the parameters of a real UAV. The training experiments show that REL-DDPG improves the convergence speed and the convergence result compared to the state-of-the-art DDPG algorithm, while the testing experiments show the applicability of the algorithm and investigate the performance under different parameter conditions. (c) 2021 Chinese Society of Aeronautics and Astronautics. Production and hosting by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

The Algorithm for UAV Obstacle Avoidance and Route Planning Based on Reinforcement Learning

A Study on Path Planning Algorithms of UAV Collision Avoidance

A Modified Q-learning Algorithm Facing for Path Planning and Obstacle Avoidance Method for Unmanned Aerial Vehicle

Path Planning for Fixed-Wing UAVs Based on Expert Knowledge and Improved VFH in Cluttered Environments

End-to-End Learning-Based Obstacle Avoidance for Fixed-Wing UAVs

Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs.

Q Learning Algorithm Based UAV Path Learning and Obstacle Avoidence Approach

An Improved Geometrical Path Planning Algorithm For Uav In Irregular-Obstacle Environment

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

A Hybrid Human-in-the-Loop Deep Reinforcement Learning Method for UAV Motion Planning for Long Trajectories with Unpredictable Obstacles

Study on a Kind of Local Path Replanning Algorithm for UAVs

Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments

UAV Path Planning and Obstacle Avoidance Based on Reinforcement Learning in 3D Environments

A Dense Obstacle Avoidance Algorithm for UAVs Based on Safe Flight Corridor

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

Collision Avoidance for Cooperative Uavs with Rolling Optimization Algorithm Based on Predictive State Space

A Saliency-Based Reinforcement Learning Approach for a UAV to Avoid Flying Obstacles

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs

3M-RL: Multi-Resolution, Multi-Agent, Mean-Field Reinforcement Learning for Autonomous UAV Routing