Abstract:A key necessity for the safe and autonomous flight of Unmanned Aircraft Systems (UAS) is their reliable perception of the environment, for example, to assess the safety of a landing site. For visual perception, Machine Learning (ML) provides state-of-the-art results in terms of performance, but the path to aviation certification has yet to be determined as current regulation and standard documents are not applicable to ML-based components due to their data-defined properties. However, the European Union Aviation Safety Agency (EASA) published the first usable guidance documents that take ML-specific challenges, such as data management and learning assurance, into account. In this paper, an important concept in this context is addressed, namely the Operational Design Domain (ODD) that defines the limitations under which a given ML-based system is designed to operate and function correctly. We investigated whether synthetic data can be used to complement a real-world training dataset which does not cover the whole ODD of an ML-based system component for visual object detection. The use-case in focus is the detection of humans on the ground to assess the safety of landing sites. Synthetic data are generated using the methods proposed in the EASA documents, namely augmentations, stitching and simulation environments. These data are used to augment a real-world dataset to increase ODD coverage during the training of Faster R-CNN object detection models. Our results give insights into the generation techniques and usefulness of synthetic data in the context of increasing ODD coverage. They indicate that the different types of synthetic images vary in their suitability but that augmentations seem to be particularly promising when there is not enough real-world data to cover the whole ODD. By doing so, our results contribute towards the adoption of ML technology in aviation and the reduction of data requirements for ML perception systems.

Sim2Air - Synthetic aerial dataset for UAV monitoring

SynDroneVision: A Synthetic Dataset for Image-Based Drone Detection

SynDrone -- Multi-modal UAV Dataset for Urban Scenarios

A Novel Dataset and Detection Method for Unmanned Aerial Vehicles Using an Improved YOLOv9 Algorithm

RarePlanes: Synthetic Data Takes Flight

Exploring the Impact of Synthetic Data for Aerial-view Human Detection

Synthetic Data Generation Based on Multi-stage Blending Strategy for Airport Runway Detection in Areas of Heterogeneous Land Cover from Remote Sensing Images

SeaDroneSim: Simulation of Aerial Images for Detection of Objects Above Water

Training Deep Learning Models via Synthetic Data: Application in Unmanned Aerial Vehicles

UEMM-Air: A Synthetic Multi-modal Dataset for Unmanned Aerial Vehicle Object Detection

Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles

SkyScenes: A Synthetic Dataset for Aerial Scene Understanding

SkyAI Sim: An Open-Source Simulation of UAV Aerial Imaging from Satellite Data

Filling the Gaps: Using Synthetic Low-Altitude Aerial Images to Increase Operational Design Domain Coverage

Synthetic Data Augmentation Using Multiscale Attention CycleGAN for Aircraft Detection in Remote Sensing Images

Synthetica: Large Scale Synthetic Data for Robot Perception

Stable Diffusion For Aerial Object Detection

SynRS3D: A Synthetic Dataset for Global 3D Semantic Understanding from Monocular Remote Sensing Imagery

Synthetic Data for Sentinel-2 Semantic Segmentation

Archangel: A Hybrid UAV-based Human Detection Benchmark with Position and Pose Metadata

Synthetic Image Data for Deep Learning