Abstract:The performance of still-to-video FR systems can decline significantly because faces captured in unconstrained operational domain (OD) over multiple video cameras have a different underlying data distribution compared to faces captured under controlled conditions in the enrollment domain (ED) with a still camera. This is particularly true when individuals are enrolled to the system using a single reference still. To improve the robustness of these systems, it is possible to augment the reference set by generating synthetic faces based on the original still. However, without knowledge of the OD, many synthetic images must be generated to account for all possible capture conditions. FR systems may, therefore, require complex implementations and yield lower accuracy when training on many less relevant images. This paper introduces an algorithm for domain-specific face synthesis (DSFS) that exploits the representative intra-class variation information available from the OD. Prior to operation, a compact set of faces from unknown persons appearing in the OD is selected through clustering in the captured condition space. The domain-specific variations of these face images are projected onto the reference stills by integrating an image-based face relighting technique inside the 3D reconstruction framework. A compact set of synthetic faces is generated that resemble individuals of interest under the capture conditions relevant to the OD. In a particular implementation based on sparse representation classification, the synthetic faces generated with the DSFS are employed to form a cross-domain dictionary that account for structured sparsity. Experimental results reveal that augmenting the reference gallery set of FR systems using the proposed DSFS approach can provide a higher level of accuracy compared to state-of-the-art approaches, with only a moderate increase in its computational complexity.

Towards improving synthetic-to-real image correlation for instance recognition in structure monitoring

Combining Synthetic Images and Deep Active Learning: Data-Efficient Training of an Industrial Object Detection Model

Unsupervised Domain Adaptation Approach for Vision-Based Semantic Understanding of Bridge Inspection Scenes Without Manual Annotations

From Fake to Real: Pretraining on Balanced Synthetic Images to Prevent Spurious Correlations in Image Recognition

Analysis of Classifier Training on Synthetic Data for Cross-Domain Datasets

SynFace: Face Recognition with Synthetic Data

Synthetic Data for Object Classification in Industrial Applications

Synthetic Data for Face Recognition: Current State and Future Prospects

Synthetica: Large Scale Synthetic Data for Robot Perception

Exploring the Impact of Synthetic Data for Aerial-view Human Detection

If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Faces

Face Recognition Using Synthetic Face Data

SynCDR : Training Cross Domain Retrieval Models with Synthetic Data

Domain-Specific Face Synthesis for Video Face Recognition from a Single Sample Per Person

Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images

Investigation of the Impact of Synthetic Training Data in the Industrial Application of Terminal Strip Object Detection

Improving Object Detector Training on Synthetic Data by Starting With a Strong Baseline Methodology

Beyond Photo Realism for Domain Adaptation from Synthetic Data

Visual Car Brand Classification by Implementing a Synthetic Image Dataset Creation Pipeline

Structure-aware feature stylization for domain generalization

Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspective