Abstract:Unmanned Aerial Vehicles (UAVs) play a vital role in military warfare. In a variety of battlefield mission scenarios, UAVs are required to safely fly to designated locations without human intervention. Therefore, finding a suitable method to solve the UAV Autonomous Motion Planning (AMP) problem can improve the success rate of UAV missions to a certain extent. In recent years, many studies have used Deep Reinforcement Learning (DRL) methods to address the AMP problem and have achieved good results. From the perspective of sampling, this paper designs a sampling method with double-screening, combines it with the Deep Deterministic Policy Gradient (DDPG) algorithm, and proposes the Relevant Experience Learning-DDPG (REL-DDPG) algorithm. The REL-DDPG algorithm uses a Prioritized Experience Replay (PER) mechanism to break the correlation of continuous experiences in the experience pool, finds the experiences most similar to the current state to learn according to the theory in human education, and expands the influence of the learning process on action selection at the current state. All experiments are applied in a complex unknown simulation environment constructed based on the parameters of a real UAV. The training experiments show that REL-DDPG improves the convergence speed and the convergence result compared to the state-of-the-art DDPG algorithm, while the testing experiments show the applicability of the algorithm and investigate the performance under different parameter conditions. (c) 2021 Chinese Society of Aeronautics and Astronautics. Production and hosting by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Path planning for underwater gliders in time-varying ocean current using deep reinforcement learning

Based on Deep Reinforcement Learning to Path Planning in Uncertain Ocean Currents for Underwater Gliders

Deep reinforcement learning-based path planning method for underwater gliders in unknown 3D marine environment

Path Planning of Unmanned Underwater Vehicles Based on Deep Reinforcement Learning Algorithm

Action Guidance-Based Deep Interactive Reinforcement Learning for AUV Path Planning

Research and Design of an Autonomous Underwater Vehicle Path Planning Method Based on Deep Reinforcement Learning

Trajectory Tracking of an Underwater Glider in Current Based on Deep Reinforcement Learning

Recent advances in path planning for underwater gliders: A comprehensive review

Global Path Planning for Amphibious Unmanned Vehicles with Multiple Constraints Via Deep Reinforcement Learning

Research on Constraining Strategies of Underwater Glider's Trajectory under the Influence of Ocean Currents Based on DQN Algorithm

Path Planning based on Deep Reinforcement Learning for Autonomous Underwater Vehicles under Ocean Current Disturbance

Research on Underwater Gliders Path Tracking Based on Reinforcement Learning Algorithm

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

AUV Collision Avoidance Planning Method Based on Deep Deterministic Policy Gradient

Path Planning for Underactuated Unmanned Surface Vehicle Swarm Based on Deep Reinforcement Learning

Path planning of autonomous underwater vehicle in unknown environment based on improved deep reinforcement learning

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Deep Reinforcement Learning-Based Path Planning of Underactuated Surface Vessels

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Improved RRT Algorithms to Solve Path Planning of Multi-Glider in Time-Varying Ocean Currents

Effective Underwater Glider Path Planning in Dynamic 3D Environments Using Multi-Point Potential Fields