Abstract:Unmanned Aerial Vehicles (UAVs) play a vital role in military warfare. In a variety of battlefield mission scenarios, UAVs are required to safely fly to designated locations without human intervention. Therefore, finding a suitable method to solve the UAV Autonomous Motion Planning (AMP) problem can improve the success rate of UAV missions to a certain extent. In recent years, many studies have used Deep Reinforcement Learning (DRL) methods to address the AMP problem and have achieved good results. From the perspective of sampling, this paper designs a sampling method with double-screening, combines it with the Deep Deterministic Policy Gradient (DDPG) algorithm, and proposes the Relevant Experience Learning-DDPG (REL-DDPG) algorithm. The REL-DDPG algorithm uses a Prioritized Experience Replay (PER) mechanism to break the correlation of continuous experiences in the experience pool, finds the experiences most similar to the current state to learn according to the theory in human education, and expands the influence of the learning process on action selection at the current state. All experiments are applied in a complex unknown simulation environment constructed based on the parameters of a real UAV. The training experiments show that REL-DDPG improves the convergence speed and the convergence result compared to the state-of-the-art DDPG algorithm, while the testing experiments show the applicability of the algorithm and investigate the performance under different parameter conditions. (c) 2021 Chinese Society of Aeronautics and Astronautics. Production and hosting by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning

UAV Target Tracking Method Based on Deep Reinforcement Learning

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

UAV Visual Flight Control Method Based on Deep Reinforcement Learning

An Improved Method towards Multi-UAV Autonomous Navigation Using Deep Reinforcement Learning

UAV Maneuvering Target Tracking in Uncertain Environments Based on Deep Reinforcement Learning and Meta-Learning

Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning

Research on Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Improved Dueling DQN Algorithm

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Multi-UAV Cooperative Pursuit of a Fast-Moving Target UAV Based on the GM-TD3 Algorithm

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

A Two-Stage Target Search and Tracking Method for UAV Based on Deep Reinforcement Learning

Research on multi-UAV task decision-making based on improved MADDPG algorithm and transfer learning

UAV maneuvering decision -making algorithm based on Twin Delayed Deep Deterministic Policy Gradient Algorithm

Maneuvering target tracking of UAV based on MN-DDPG and transfer learning

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

Autonomous Target Tracking of Multi-Uav: A Two-Stage Deep Reinforcement Learning Approach with Expert Experience

Intelligent Decision-Making for 3-Dimensional Dynamic Obstacle Avoidance of UAV Based on Deep Reinforcement Learning

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment