Abstract:Safe autonomous landing for Unmanned Aerial Vehicles (UAVs) in populated areas is a crucial aspect for successful integration of UAVs in populated environments. Nonetheless, validating autonomous landing in real scenarios is a challenging task with a high risk of injuring people. In this work, we propose a framework for safe real-time and thorough evaluation of vision-based autonomous landing in populated scenarios, using photo-realistic virtual environments and physics-based simulation. The proposed evaluation pipeline includes the use of Unreal graphics engine coupled with AirSim for realistic drone simulation to evaluate landing strategies. Then, Software-/Hardware-In-The-Loop can be used to test beforehand the performance of the algorithms. The final validation stage consists in a Robot-In-The-Loop evaluation strategy where a real drone must perform autonomous landing maneuvers in real-time, with an avatar drone in a virtual environment mimicking its behavior, while the detection algorithms run in the virtual environment (virtual reality to the robot). This method determines the safe landing areas based on computer vision and convolutional neural networks to avoid colliding with people in static and dynamic scenarios. To test the robustness of the algorithms in adversary conditions, different urban-like environments were implemented, including moving agents and different weather conditions. We also propose different metrics to quantify the performance of the landing strategies, establishing a baseline for comparison with future works on this challenging task, and analyze them through several randomized iterations. The proposed approach allowed us to safely validate the autonomous landing strategies, providing an evaluation pipeline, and a benchmark for comparison. An extensive evaluation showed a 99% success rate in static scenarios and 87% in dynamic cases, demonstrating that the use of autonomous landing algorithms considerably prevents accidents involving humans, facilitating the integration of drones in human-populated spaces, which may help to unleash the full potential of drones in urban environments. Besides, this type of development helps to increase the safety of drone operations, which would advance drone flight regulations and allow their use in closer proximity to humans.

Analyzing visual imagery for emergency drone landing on unknown environments

An Automatic Zone Detection System for Safe Landing of UAVs

Emergency Landing Spot Detection Algorithm for Unmanned Aerial Vehicles

Autonomous Multirotor UAV Search and Landing on Safe Spots Based on Combined Semantic and Depth Information From an Onboard Camera and LiDAR

Vision-based UAV Safe Landing exploiting Lightweight Deep Neural Networks

On the Visual-based Safe Landing of UAVs in Populated Areas: a Crucial Aspect for Urban Deployment

A fast, lightweight deep learning vision pipeline for autonomous UAV landing support with added robustness

Visual Environment Assessment for Safe Autonomous Quadrotor Landing

Real-Time Heuristic Framework for Safe Landing of UAVs in Dynamic Scenarios

Vision-based Autonomous Landing in Catastrophe-Struck Environments

Deep-Learning-Based Aerial Image Classification for Emergency Response Applications Using Unmanned Aerial Vehicles

IMAGE PROCESSING BASED AUTONOMOUS LANDING ZONE DETECTION FOR A MULTI-ROTOR DRONE IN EMERGENCY SITUATIONS

Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation

Target Localization for Autonomous Landing Site Detection: A Review and Preliminary Result with Static Image Photogrammetry

Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs

Vision-Based Autonomous UAV Navigation and Landing for Urban Search and Rescue

Visual-based Safe Landing for UAVs in Populated Areas: Real-time Validation in Virtual Environments

Real-time safe validation of autonomous landing in populated areas: from virtual environments to Robot-In-The-Loop

Visual Navigation Algorithm for Night Landing of Fixed-Wing Unmanned Aerial Vehicle

Image Segmentation to Identify Safe Landing Zones for Unmanned Aerial Vehicles

Robust Autonomous Landing of UAV in Non-Cooperative Environments based on Dynamic Time Camera-LiDAR Fusion