Abstract:In this paper, we address the multiple quadrotor UAVs trajectory planning optimization problem for large-scale, persistent, high-depth visual coverage tasks in three-dimensional (3-D) terrain environment. To minimize the overall energy expenditure of the UAVs for accomplishing a task, we set up an air-to-ground collaborative system which introduces base stations to hold and recharge UAVs. The system is formulated as an integer programming, and solved by a novel hierarchical reinforcement learning trajectory planning algorithm (RL-TP), in which the paths are obtained by reinforcement learning method, and then the trajectories are obtained by Bézier curve method. Both simulation and physical experiments show that RL-TP can effectively improve the efficiency and persistence of aerial visual coverage task. Note to Practitioners —While the multi-rotor UAV has been an important means for field monitoring, it suffers the problem of short battery life a lot. To make it more efficient and persistent, we use multiple UAVs and introduce ground base stations to charge the UAVs. The scenario is formulated as an air-to-ground collaborative system, and the motion planning strategy is to minimize the energy consumption. We propose a hierarchical collaborative coverage reinforcement learning trajectory planning algorithm (RL-TP) to solve it. We carry out both simulation and physical field experiments, and compare RL-TP with other popular methods. The experimental results show that the system is feasible and RL-TP performs well in both time efficiency and energy consumption. In future research, we will introduce unmanned ground vehicles to replace the stationary ground base stations to make the air-to-ground collaborative system more powerful and flexible.

Collaborative Coverage Path Planning of UAV Cluster based on Deep Reinforcement Learning

Deep Reinforcement Learning-based Collaborative Multi-UAV Coverage Path Planning

Multi-UAV Coverage Path Planning: A Distributed Online Cooperation Method

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

Distributed Collaborative Complete Coverage Path Planning Based on Hybrid Strategy

Joint Optimization of Multi-UAV Deployment and User Association Via Deep Reinforcement Learning for Long-Term Communication Coverage

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

Collaborative Search Planning of UAV Swarms Based on Deep Reinforcement Learning

A UAV Coverage Path Planning Algorithm Based on Double Deep Q-Network

A deep reinforcement learning based distributed multi-UAV dynamic area coverage algorithm for complex environment

Cooperative Motion Planning for Persistent 3D Visual Coverage with Multiple Quadrotor UAVs

UAV Coverage Path Planning Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Three-Dimensional Area Coverage With UAV Swarm

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Multi-UAVs Collaborative Path Planning in the Cramped Environment

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Collaborative Encirclement of Multiple UAVs Based on Deep Reinforcement Learning

Multiple UAVs Path Planning Based on Deep Reinforcement Learning in Communication Denial Environment

Balanced Multi-Region Coverage Path Planning for Unmanned Aerial Vehicles.

Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method