Abstract:Pedestrian detection through Computer Vision is a building block for a multitude of applications. Recently, there was an increasing interest in Convolutional Neural Network-based architectures for the execution of such a task. One of these supervised networks' critical goals is to generalize the knowledge learned during the training phase to new scenarios with different characteristics. A suitably labeled dataset is essential to achieve this purpose. The main problem is that manually annotating a dataset usually requires a lot of human effort, and it is costly. To this end, we introduce ViPeD (Virtual Pedestrian Dataset), a new synthetically generated set of images collected with the highly photo-realistic graphical engine of the video game GTA V - Grand Theft Auto V, where annotations are automatically acquired. However, when training solely on the synthetic dataset, the model experiences a Synthetic2Real Domain Shift leading to a performance drop when applied to real-world images. To mitigate this gap, we propose two different Domain Adaptation techniques suitable for the pedestrian detection task, but possibly applicable to general object detection. Experiments show that the network trained with ViPeD can generalize over unseen real-world scenarios better than the detector trained over real-world data, exploiting the variety of our synthetic dataset. Furthermore, we demonstrate that with our Domain Adaptation techniques, we can reduce the Synthetic2Real Domain Shift, making closer the two domains and obtaining a performance improvement when testing the network over the real-world images. The code, the models, and the dataset are made freely available at <a class="link-external link-https" href="https://ciampluca.github.io/viped/" rel="external noopener nofollow">this https URL</a>

Generation of Synthetic Images for Pedestrian Detection Using a Sequence of GANs

Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyond

ParGANDA: Making Synthetic Pedestrians A Reality For Object Detection

No One Can Escape: A General Approach to Detect Tampered and Generated Image

Pose and Color-Gamut Guided Generative Adversarial Network for Pedestrian Image Synthesis

A novel data augmentation scheme for pedestrian detection with attribute preserving GAN

Distant Pedestrian Detection in the Wild using Single Shot Detector with Deep Convolutional Generative Adversarial Networks

Robust pedestrian detection in thermal imagery using synthesized images

MGD-GAN: Text-to-Pedestrian Generation Through Multi-grained Discrimination

Analysis of abnormal pedestrian behaviors at grade crossings based on semi-supervised generative adversarial networks

Synthetic Data Generation Framework, Dataset, and Efficient Deep Model for Pedestrian Intention Prediction

Controllable instance synthesis with hierarchical regularization for semi-supervised pedestrian detection

Pedestrian Detection for Autonomous Vehicles Using Virtual-to-Real Augmentation

Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels

Detecting GAN-generated Images by Orthogonal Training of Multiple CNNs

Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs

Virtual to Real adaptation of Pedestrian Detectors

Attention-based Adversarial Appearance Learning of Augmented Pedestrians

Detection, Attribution and Localization of GAN Generated Images

Domain adaptive person search via GAN-based scene synthesis for cross-scene videos

Stochastic Sampling Simulation for Pedestrian Trajectory Prediction