Abstract:The reconnaissance of high-value targets is prerequisite for effective operations. The recent appreciation of deep reinforcement learning (DRL) arises from its success in navigation problems, but due to the competitiveness and complexity of the military field, the applications of DRL in the military field are still unsatisfactory. In this paper, an end-to-end DRL-based intelligent reconnaissance mission planning is proposed for dual unmanned aerial vehicle (dual UAV) cooperative reconnaissance missions under high-threat and dense situations. Comprehensive consideration is given to specific mission properties and parameter requirements through the whole modelling. Firstly, the reconnaissance mission is described as a Markov decision process (MDP), and the mission planning model based on DRL is established. Secondly, the environment and UAV motion parameters are standardized to input the neural network, aiming to deduce the difficulty of algorithm convergence. According to the concrete requirements of non-reconnaissance by radars, dual-UAV cooperation and wandering reconnaissance in the mission, four reward functions with weights are designed to enhance agent understanding to the mission. To avoid sparse reward, the clip function is used to control the reward value range. Finally, considering the continuous action space of reconnaissance mission planning, the widely applicable proximal policy optimization (PPO) algorithm is used in this paper. The simulation is carried out by combining offline training and online planning. By changing the location and number of ground detection areas, from 1 to 4, the model with PPO can maintain 20% of reconnaissance proportion and a 90% mission complete rate and help the reconnaissance UAV to complete efficient path planning. It can adapt to unknown continuous high-dimensional environmental changes, is generalizable, and reflects strong intelligent planning performance.

Adaptive Cooperative Detection Method for Unmanned Planetary Vehicles Based on Deep Reinforcement Learning

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

A Learning-Based Flexible Autonomous Motion Control Method for UAV in Dynamic Unknown Environments

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

A Mission Planning Method for Deep Space Detectors Using Deep Reinforcement Learning

Multi-UAV Collaborative Detection Based on Reinforcement Learning.

Adaptive Path Planning for Unmanned Planetary Rover with Dynamic Obstacle

UAV Autonomous Tracking and Landing Based on Deep Reinforcement Learning Strategy

Real-time Planning and Collision Avoidance Control Method Based on Deep Reinforcement Learning

Cooperative Landing on Mobile Platform for Multiple Unmanned Aerial Vehicles Via Reinforcement Learning

Unmanned Aerial Vehicle Path Planning Algorithm Based on Deep Reinforcement Learning in Large-Scale and Dynamic Environments

Deep-learning based autonomous-exploration for UAV navigation

Adaptive speed planning for Unmanned Vehicle Based on Deep Reinforcement Learning

A Hybrid Human-in-the-Loop Deep Reinforcement Learning Method for UAV Motion Planning for Long Trajectories with Unpredictable Obstacles

Deep Reinforcement Learning for Intelligent Dual-UAV Reconnaissance Mission Planning

Confrontation and Obstacle-Avoidance of Unmanned Vehicles Based on Progressive Reinforcement Learning.

Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing

Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning

Deep Multi-Layer Perception Based Terrain Classification For Planetary Exploration Rovers

A Preliminary Study on Intelligent Perception of Extraterrestrial Body Surface Based on Deep Learning and Transfer Learning