Abstract:Multi-unmanned aerial vehicle (multi-UAV) cooperative trajectory planning is an extremely challenging issue in UAV research field due to its NP-hard characteristic, collision avoiding constraints, close formation requirement, consensus convergence and high-dimensional action space etc. Especially, the difficulty of multi-UAV trajectory planning will boost comparatively when there are complex obstacles and narrow passages in unknown environments. Accordingly, a novel multi-UAV adaptive cooperative formation trajectory planning approach is proposed in this paper based on an improved deep reinforcement learning algorithm in unknown obstacle environments, which innovatively introduces long short-term memory (LSTM) recurrent neural network (RNN) into the environment perception end of multiagent twin delayed deep deterministic policy gradient (MATD3) network, and develops an improved potential field-based dense reward function to strengthen the policy learning efficiency and accelerates the convergence respectively. Moreover, a hierarchical deep reinforcement learning training mechanism, including adaptive formation layer, trajectory planning layer and action execution layer is implemented to explore an optimal trajectory planning policy. Additionally, an adaptive formation maintaining and transformation strategy is presented for UAV swarm to comply with the environment with narrow passages. Simulation results show that the proposed approach is better in policy learning efficiency, optimality of trajectory planning policy and adaptability to narrow passages than that using multi-agent deep deterministic policy gradient (MADDPG) and MATD3.

Enhanced Multi-UAV Path Planning in Complex Environments With Voronoi-Based Obstacle Modelling and Q-Learning

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

A Modified Q-learning Algorithm Facing for Path Planning and Obstacle Avoidance Method for Unmanned Aerial Vehicle

Multi-obstacle Path Planning of UAV Based on Improved Ant Colony System Algorithm

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Path Planning for Fixed-Wing UAVs Based on Expert Knowledge and Improved VFH in Cluttered Environments

Multi-UAV Path Planning Based on Potential Field Dense Reward in Unknown Environments with Static and Dynamic Obstacles

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Study on a Kind of Local Path Replanning Algorithm for UAVs

Reinforcement-learning-based path planning for UAVs in intensive obstacle environment

An Improved Geometrical Path Planning Algorithm For Uav In Irregular-Obstacle Environment

A Study on Path Planning Algorithms of UAV Collision Avoidance

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

Multi-UAVs Collaborative Path Planning in the Cramped Environment

Dynamic Discrete Pigeon-Inspired Optimization for Multi-UAV Cooperative Search-Attack Mission Planning

Optimized multi-UAV cooperative path planning under the complex confrontation environment

UAV Motion Strategies in Uncertain Dynamic Environments: A Path Planning Method Based on Q-Learning Strategy

A New Autonomous Method of Drone Path Planning Based on Multiple Strategies for Avoiding Obstacles with High Speed and High Density