Abstract:This paper considers the dynamic coverage control of multi-rotor Unmanned Aerial Vehicles (UAVs) with the limited sensory range, which aims to collect sensor information from all points of interest in the given task area until the desired prescribed level is reached. However, the unknown environments are usually unavoidable for coverage task, where the presence of various obstacles and communication interferences affect the flight safety and communication stability of UAVs. Therefore, collision avoidance and connectivity maintenance are considered as the two safety issues in this paper, in which connectivity maintenance ensures the communication environment for UAVs to collaboratively accomplish task, and collision avoidance is used for UAVs to avoid obstacles and neighbors. In order to realize dynamic coverage control with safety constraints based on local environment information, this paper proposes the reinforcement learning-based algorithm with shield, where the shield designed by discrete-time Control Barrier Function (CBF) not only ensures the safety of the UAVs in the learning and control phases, but also maximizes the coverage performance of UAVs. In addition, each UAV only relies on local information to generate safe actions for advancing the coverage process during the execution phase. Finally, the effectiveness of the algorithm is verified by numerical simulations and physical experiment. Note to Practitioners —A typical application scenario of dynamic coverage control is search and rescue (SAR), in which UAVs equipped with multiple sensors focus on monitoring areas where trapped people may be present, e.g., anomalous areas detected by infrared sensors due to human body temperature. Since SAR always occurs in unknown environments, it is crucial to ensure the safety of UAVs during missions, of which the safety issues considered in this paper include collision avoidance and connectivity maintenance. To perform the SAR mission safely, we construct the CBF-based shield, which minimizes corrections the exploration actions of the UAVs and ensures the safety of the cluster during the mission. In addition, UAVs are difficult to obtain global environmental information in unknown environments and only rely on their sensors to collect local information. Therefore, the reinforcement learning algorithm with shield proposed in this paper adopts the centralized training and decentralized execution strategy, where the UAVs only need local observation information to plan their next actions. Physical experiments were also conducted to validate the feasibility of implementing the proposed algorithm using real UAVs.

Demonstrating Reinforcement Learning and Run Time Assurance for Spacecraft Inspection Using Unmanned Aerial Vehicles

Run Time Assured Reinforcement Learning for Six Degree-of-Freedom Spacecraft Inspection

Safe Spacecraft Inspection via Deep Reinforcement Learning and Discrete Control Barrier Functions

Run Time Assurance for Autonomous Spacecraft Inspection

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Space Processor Computation Time Analysis for Reinforcement Learning and Run Time Assurance Control Policies

Deep Reinforcement Learning for Autonomous Spacecraft Inspection using Illumination

Reinforcement Learning-based Optimal Control and Software Rejuvenation for Safe and Efficient UAV Navigation

Safe and Reliable Training of Learning-Based Aerospace Controllers

Automating Aircraft Scanning For Inspection With A UAV And Reinforcement Learning Technique

Neural-based Control for CubeSat Docking Maneuvers

Run Time Assurance for Simultaneous Constraint Satisfaction During Spacecraft Attitude Maneuvering

Runtime Safety Assurance Using Reinforcement Learning

Spacecraft Autonomous Decision-Planning for Collision Avoidance: a Reinforcement Learning Approach

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Systems Theoretic Process Analysis of a Run Time Assured Neural Network Control System

Deep Reinforcement Learning for Vision-Based Navigation of UAVs in Avoiding Stationary and Mobile Obstacles

Reinforcement Learning-Based Dynamic Coverage Control of Multi-Rotor UAVs with Safety Priority

Deep Learning Fault Diagnosis for Spacecraft Attitude Determination and Control

Reinforcement Learning for UAV Autonomous Navigation, Mapping and Target Detection

Deep Reinforcement Learning for Joint Cruise Control and Intelligent Data Acquisition in UAVs-Assisted Sensor Networks