Abstract:Safe autonomous landing for Unmanned Aerial Vehicles (UAVs) in populated areas is a crucial aspect for successful integration of UAVs in populated environments. Nonetheless, validating autonomous landing in real scenarios is a challenging task with a high risk of injuring people. In this work, we propose a framework for safe real-time and thorough evaluation of vision-based autonomous landing in populated scenarios, using photo-realistic virtual environments and physics-based simulation. The proposed evaluation pipeline includes the use of Unreal graphics engine coupled with AirSim for realistic drone simulation to evaluate landing strategies. Then, Software-/Hardware-In-The-Loop can be used to test beforehand the performance of the algorithms. The final validation stage consists in a Robot-In-The-Loop evaluation strategy where a real drone must perform autonomous landing maneuvers in real-time, with an avatar drone in a virtual environment mimicking its behavior, while the detection algorithms run in the virtual environment (virtual reality to the robot). This method determines the safe landing areas based on computer vision and convolutional neural networks to avoid colliding with people in static and dynamic scenarios. To test the robustness of the algorithms in adversary conditions, different urban-like environments were implemented, including moving agents and different weather conditions. We also propose different metrics to quantify the performance of the landing strategies, establishing a baseline for comparison with future works on this challenging task, and analyze them through several randomized iterations. The proposed approach allowed us to safely validate the autonomous landing strategies, providing an evaluation pipeline, and a benchmark for comparison. An extensive evaluation showed a 99% success rate in static scenarios and 87% in dynamic cases, demonstrating that the use of autonomous landing algorithms considerably prevents accidents involving humans, facilitating the integration of drones in human-populated spaces, which may help to unleash the full potential of drones in urban environments. Besides, this type of development helps to increase the safety of drone operations, which would advance drone flight regulations and allow their use in closer proximity to humans.

Emergency Landing Spot Detection Algorithm for Unmanned Aerial Vehicles

Potential UAV Landing Sites Detection through Digital Elevation Models Analysis

Autonomous Multirotor UAV Search and Landing on Safe Spots Based on Combined Semantic and Depth Information From an Onboard Camera and LiDAR

On the Visual-based Safe Landing of UAVs in Populated Areas: a Crucial Aspect for Urban Deployment

An Automatic Zone Detection System for Safe Landing of UAVs

Analyzing visual imagery for emergency drone landing on unknown environments

UAV Landing Using Computer Vision Techniques for Human Detection

A Multimodal Learning-based Approach for Autonomous Landing of UAV

A Vision-Based Algorithm for Landing Unmanned Aerial Vehicles

Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs

Free LSD: Prior-Free Visual Landing Site Detection for Autonomous Planes

Real-Time Heuristic Framework for Safe Landing of UAVs in Dynamic Scenarios

Operational Control of an Unmanned Helicopter to Ensure an Emergency Safe Landing on an Unequipped Pad

Robust Autonomous Landing of UAV in Non-Cooperative Environments based on Dynamic Time Camera-LiDAR Fusion

Visual-based Safe Landing for UAVs in Populated Areas: Real-time Validation in Virtual Environments

Target Localization for Autonomous Landing Site Detection: A Review and Preliminary Result with Static Image Photogrammetry

Vision-based Autonomous Landing in Catastrophe-Struck Environments

A fast, lightweight deep learning vision pipeline for autonomous UAV landing support with added robustness

Vision-Based Autonomous UAV Navigation and Landing for Urban Search and Rescue

Real-time safe validation of autonomous landing in populated areas: from virtual environments to Robot-In-The-Loop

Remote Marker-Based Tracking for UAV Landing Using Visible-Light Camera Sensor