Abstract:This paper considers the dynamic coverage control of multi-rotor Unmanned Aerial Vehicles (UAVs) with the limited sensory range, which aims to collect sensor information from all points of interest in the given task area until the desired prescribed level is reached. However, the unknown environments are usually unavoidable for coverage task, where the presence of various obstacles and communication interferences affect the flight safety and communication stability of UAVs. Therefore, collision avoidance and connectivity maintenance are considered as the two safety issues in this paper, in which connectivity maintenance ensures the communication environment for UAVs to collaboratively accomplish task, and collision avoidance is used for UAVs to avoid obstacles and neighbors. In order to realize dynamic coverage control with safety constraints based on local environment information, this paper proposes the reinforcement learning-based algorithm with shield, where the shield designed by discrete-time Control Barrier Function (CBF) not only ensures the safety of the UAVs in the learning and control phases, but also maximizes the coverage performance of UAVs. In addition, each UAV only relies on local information to generate safe actions for advancing the coverage process during the execution phase. Finally, the effectiveness of the algorithm is verified by numerical simulations and physical experiment. Note to Practitioners —A typical application scenario of dynamic coverage control is search and rescue (SAR), in which UAVs equipped with multiple sensors focus on monitoring areas where trapped people may be present, e.g., anomalous areas detected by infrared sensors due to human body temperature. Since SAR always occurs in unknown environments, it is crucial to ensure the safety of UAVs during missions, of which the safety issues considered in this paper include collision avoidance and connectivity maintenance. To perform the SAR mission safely, we construct the CBF-based shield, which minimizes corrections the exploration actions of the UAVs and ensures the safety of the cluster during the mission. In addition, UAVs are difficult to obtain global environmental information in unknown environments and only rely on their sensors to collect local information. Therefore, the reinforcement learning algorithm with shield proposed in this paper adopts the centralized training and decentralized execution strategy, where the UAVs only need local observation information to plan their next actions. Physical experiments were also conducted to validate the feasibility of implementing the proposed algorithm using real UAVs.

Dynamic Obstacle Avoidance of Fixed-wing Aircraft in Final Phase Via Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

End-to-End Learning-Based Obstacle Avoidance for Fixed-Wing UAVs

Collision-Aware Navigation for Flapping-Wing Aerial Robots in Dense Environments

Reinforcement Learning-based Hierarchical Obstacle Avoidance Strategy for Fixed-wing Aircraft

Intelligent Decision-Making for 3-Dimensional Dynamic Obstacle Avoidance of UAV Based on Deep Reinforcement Learning

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning

Learning-based fixed-wing UAV reactive maneuver control for obstacle avoidance

Hierarchical Goal-Guided Learning for the Evasive Maneuver of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Vision Based Drone Obstacle Avoidance by Deep Reinforcement Learning

Enhanced method for reinforcement learning based dynamic obstacle avoidance by assessment of collision risk

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs

Two-step dynamic obstacle avoidance

Real-time Obstacle Avoidance with Deep Reinforcement Learning Three-Dimensional Autonomous Obstacle Avoidance for UAV

Deep Reinforcement Learning for Vision-Based Navigation of UAVs in Avoiding Stationary and Mobile Obstacles

Intercepting Unauthorized Aerial Robots in Controlled Airspace Using Reinforcement Learning

A Hybrid Human-in-the-Loop Deep Reinforcement Learning Method for UAV Motion Planning for Long Trajectories with Unpredictable Obstacles

Reinforcement Learning-Based Dynamic Coverage Control of Multi-Rotor UAVs with Safety Priority