Abstract:In this paper, we address the multiple quadrotor UAVs trajectory planning optimization problem for large-scale, persistent, high-depth visual coverage tasks in three-dimensional (3-D) terrain environment. To minimize the overall energy expenditure of the UAVs for accomplishing a task, we set up an air-to-ground collaborative system which introduces base stations to hold and recharge UAVs. The system is formulated as an integer programming, and solved by a novel hierarchical reinforcement learning trajectory planning algorithm (RL-TP), in which the paths are obtained by reinforcement learning method, and then the trajectories are obtained by Bézier curve method. Both simulation and physical experiments show that RL-TP can effectively improve the efficiency and persistence of aerial visual coverage task. Note to Practitioners —While the multi-rotor UAV has been an important means for field monitoring, it suffers the problem of short battery life a lot. To make it more efficient and persistent, we use multiple UAVs and introduce ground base stations to charge the UAVs. The scenario is formulated as an air-to-ground collaborative system, and the motion planning strategy is to minimize the energy consumption. We propose a hierarchical collaborative coverage reinforcement learning trajectory planning algorithm (RL-TP) to solve it. We carry out both simulation and physical field experiments, and compare RL-TP with other popular methods. The experimental results show that the system is feasible and RL-TP performs well in both time efficiency and energy consumption. In future research, we will introduce unmanned ground vehicles to replace the stationary ground base stations to make the air-to-ground collaborative system more powerful and flexible.

Cooperative Path Planning with Applications to Target Tracking and Obstacle Avoidance for Multi-Uavs

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Real-Time Path Planning of Unmanned Aerial Vehicle for Target Tracking and Obstacle Avoidance in Complex Dynamic Environment

Uav Formation Flight Cooperative Tracking Controller Design

Cooperative Path Planning Method for Unmanned Aerial Vehicle Formation Using Adaptive Primal-Dual Iteration

Local Pursuit Strategy-Inspired Cooperative Formation Flight and Collision Avoidance for UAV Cluster

Co-Optimization of Communication and Sensing for Multiple Unmanned Aerial Vehicles in Cooperative Target Tracking

Three-dimensional Path Planning for Unmanned Aerial Vehicle Based on Interfered Fluid Dynamical System

Planning three-dimensional collision-avoidance path for UAV on the basis of disturbed fluid dynamical system algorithm

UAVs cooperative task assignment and trajectory optimization with safety and time constraints

Shortest Path Planning of UAV for Target Tracking and Obstacle Avoidance in 3D Environment

Cooperative Formation and Obstacle Avoidance Algorithm for Multi-UAV System in 3D Environment

On Real-time Cooperative Trajectory Planning of Aerial-ground Systems

Integrated Design of Cooperative Area Coverage and Target Tracking with Multi-UAV System

Guidance Law For Multi-Uavs Collaborative Ground Target Tracking Under Obstacle Environment

Cooperative trajectory planning algorithm of USV-UAV with hull dynamic constraints

Cooperative path following control of UAV and USV cluster for maritime search and rescue

Pigeon-inspired Optimisation-Based Cooperative Target Searching for Multi-Uav in Uncertain Environment

Cooperative Motion Planning for Persistent 3D Visual Coverage with Multiple Quadrotor UAVs

Diffeomorphism Transformation Based Uav Strategy Planning For Non-Convex Environments With Arbitrary Obstacles

UAV Standoff Tracking for Narrow-Area Target in Complex Environment