Abstract:Multi-unmanned aerial vehicle (multi-UAV) cooperative trajectory planning is an extremely challenging issue in UAV research field due to its NP-hard characteristic, collision avoiding constraints, close formation requirement, consensus convergence and high-dimensional action space etc. Especially, the difficulty of multi-UAV trajectory planning will boost comparatively when there are complex obstacles and narrow passages in unknown environments. Accordingly, a novel multi-UAV adaptive cooperative formation trajectory planning approach is proposed in this paper based on an improved deep reinforcement learning algorithm in unknown obstacle environments, which innovatively introduces long short-term memory (LSTM) recurrent neural network (RNN) into the environment perception end of multiagent twin delayed deep deterministic policy gradient (MATD3) network, and develops an improved potential field-based dense reward function to strengthen the policy learning efficiency and accelerates the convergence respectively. Moreover, a hierarchical deep reinforcement learning training mechanism, including adaptive formation layer, trajectory planning layer and action execution layer is implemented to explore an optimal trajectory planning policy. Additionally, an adaptive formation maintaining and transformation strategy is presented for UAV swarm to comply with the environment with narrow passages. Simulation results show that the proposed approach is better in policy learning efficiency, optimality of trajectory planning policy and adaptability to narrow passages than that using multi-agent deep deterministic policy gradient (MADDPG) and MATD3.

Multi-UAV Cooperative Motion Planning under Global Spatio-Temporal Path Inspiration in Constraint-Rich Dynamic Environments

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Shunted Collision Avoidance for Multi-UAV Motion Planning with Posture Constraints.

Multi-UAVs Collaborative Path Planning in the Cramped Environment

Multi-mission Path Re-planning for Multiple Unmanned Aerial Vehicles Based on Unexpected Events

Multi-UAV Coverage Path Planning: A Distributed Online Cooperation Method

Cooperative Multi-UAV Path Planning with Communication Constraints

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Multi-UAV Collaborative Target Search Method in Unknown Dynamic Environment

Hierarchical Search-Based Cooperative Motion Planning

3D Multi-Uav Cooperative Velocity-Aware Motion Planning.

Multi-UAV Cooperative Path-Planning Under Complex Threat Environment

Optimized multi-UAV cooperative path planning under the complex confrontation environment

Study on Multi-UAV Cooperative Path Planning for Complex Patrol Tasks in Large Cities

Survey of Analysis and Solutions for Multi-UAV Cooperative Mission Planning Problem Under Multi-constraint Conditions

Dynamic Discrete Pigeon-Inspired Optimization for Multi-UAV Cooperative Search-Attack Mission Planning

Offline and Online Search: UAV Multiobjective Path Planning under Dynamic Urban Environment.

Cooperative Multi-UAV Conflict Avoidance Planning in a Complex Urban Environment

Multi-Conflict-Based Optimal Algorithm for Multi-UAV Cooperative Path Planning

Multi-UAV Cooperative and Continuous Path Planning for High-Resolution 3D Scene Reconstruction

Decentralized Multi-Agent Trajectory Planning in Dynamic Environments with Spatiotemporal Occupancy Grid Maps