Abstract:Unmanned Aerial Vehicles (UAVs) play a vital role in military warfare. In a variety of battlefield mission scenarios, UAVs are required to safely fly to designated locations without human intervention. Therefore, finding a suitable method to solve the UAV Autonomous Motion Planning (AMP) problem can improve the success rate of UAV missions to a certain extent. In recent years, many studies have used Deep Reinforcement Learning (DRL) methods to address the AMP problem and have achieved good results. From the perspective of sampling, this paper designs a sampling method with double-screening, combines it with the Deep Deterministic Policy Gradient (DDPG) algorithm, and proposes the Relevant Experience Learning-DDPG (REL-DDPG) algorithm. The REL-DDPG algorithm uses a Prioritized Experience Replay (PER) mechanism to break the correlation of continuous experiences in the experience pool, finds the experiences most similar to the current state to learn according to the theory in human education, and expands the influence of the learning process on action selection at the current state. All experiments are applied in a complex unknown simulation environment constructed based on the parameters of a real UAV. The training experiments show that REL-DDPG improves the convergence speed and the convergence result compared to the state-of-the-art DDPG algorithm, while the testing experiments show the applicability of the algorithm and investigate the performance under different parameter conditions. (c) 2021 Chinese Society of Aeronautics and Astronautics. Production and hosting by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach

UAV Autonomous Navigation Based on Deep Reinforcement Learning in Highly Dynamic and High-Density Environments

Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach

UAV navigation in high dynamic environments: A deep reinforcement learning approach

A UAV Path Planning Method Based on Deep Reinforcement Learning

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Autonomous Navigation of UAV in Large-Scale Unknown Complex Environment with Deep Reinforcement Learning.

UAV Visual Flight Control Method Based on Deep Reinforcement Learning

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

Autonomous Navigation of the UAV through Deep Reinforcement Learning with Sensor Perception Enhancement

An Improved Method towards Multi-UAV Autonomous Navigation Using Deep Reinforcement Learning

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Autonomous Navigation for Cellular-Connected UAV in Highly Dynamic Environments: A Deep Reinforcement Learning Approach

Combining Motion Planner and Deep Reinforcement Learning for UAV Navigation in Unknown Environment

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

Autonomous UAV Navigation: A DDPG-based Deep Reinforcement Learning Approach