Abstract:Vision-based object detectors are a crucial basis for robotics applications as they provide valuable information about object localisation in the environment. These need to ensure high reliability in different lighting conditions, occlusions, and visual artifacts, all while running in real-time. Collecting and annotating real-world data for these networks is prohibitively time consuming and costly, especially for custom assets, such as industrial objects, making it untenable for generalization to in-the-wild scenarios. To this end, we present Synthetica, a method for large-scale synthetic data generation for training robust state estimators. This paper focuses on the task of object detection, an important problem which can serve as the front-end for most state estimation problems, such as pose estimation. Leveraging data from a photorealistic ray-tracing renderer, we scale up data generation, generating 2.7 million images, to train highly accurate real-time detection transformers. We present a collection of rendering randomization and training-time data augmentation techniques conducive to robust sim-to-real performance for vision tasks. We demonstrate state-of-the-art performance on the task of object detection while having detectors that run at 50-100Hz which is 9 times faster than the prior SOTA. We further demonstrate the usefulness of our training methodology for robotics applications by showcasing a pipeline for use in the real world with custom objects for which there do not exist prior datasets. Our work highlights the importance of scaling synthetic data generation for robust sim-to-real transfer while achieving the fastest real-time inference speeds. Videos and supplementary information can be found at this URL: <a class="link-external link-https" href="https://sites.google.com/view/synthetica-vision" rel="external noopener nofollow">this https URL</a>.

Object Features and Face Detection Performance: Analyses with 3D-Rendered Synthetic Data

Improving Face Detection Performance with 3D-Rendered Synthetic Data

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face Recognition Using Synthetic Face Data

Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset

SynFace: Face Recognition with Synthetic Data

Synthetica: Large Scale Synthetic Data for Robot Perception

ASFD: Automatic and Scalable Face Detector

Aug3D-RPN: Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth

Object Detector Differences when using Synthetic and Real Training Data

Synthetic Data for Face Recognition: Current State and Future Prospects

Can Synthetic Faces Undo the Damage of Dataset Bias to Face Recognition and Facial Landmark Detection?

Face Recognition Using Training Data with Artificial Occlusions.

If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Faces

Synthetic imagery for fuzzy object detection: A comparative study

Exploring the Impact of Synthetic Data for Aerial-view Human Detection

Analyzing the Feature Extractor Networks for Face Image Synthesis

On Recognizing Occluded Faces in the Wild

Learning Deep Object Detectors from 3D Models

Enhancing Object Detection Accuracy in Autonomous Vehicles Using Synthetic Data

Enhancing Object Detection Performance for Small Objects through Synthetic Data Generation and Proportional Class-Balancing Technique: A Comparative Study in Industrial Scenarios