Abstract:Data augmentation using 3D face models to synthesize faces has been demonstrated to be effective for face recognition. However, the model directly trained by using the synthesized faces together with the original real faces is not optimal. In this paper, we propose a novel approach that uses a deep transfer network (DTN) with 3D morphable models (3DMMs) for face recognition to overcome the shortage of labeled face images and the dataset bias between synthesized images and corresponding real images. We first utilize the 3DMM to synthesize faces with various poses to augment the training dataset. Then, we train a deep neural network using the synthesized face images and the original real face images. The results obtained on LFW show that the accuracy of the model utilizing synthesized data only is lower than that of the model using the original data, although the synthesized dataset contains much considerably images with more unconstrained poses. This result shows that a dataset bias exists between the synthesized faces and the real faces. We treat the synthesized faces as the source domain, and we treat the actual faces as the target domain. We use the DTN to alleviate the discrepancy between the source domain and the target domain. The DTN attempts to project source domain samples and target domain samples to a new space where they are fused together such that one cannot distinguish the domain from which a specific image is from. We optimize our DTN based on the maximum mean discrepancy (MMD) of the shared feature extraction layers and the discrimination layers. We choose AlexNet and Inception-ResNet-V1 as our benchmark models. The proposed method is also evaluated on the LFW and SLLFW databases. The experimental results show that our method can effectively address the domain discrepancy. Moreover, the dataset bias between the synthesized data and the real data is remarkably reduced, which can thus improve the performance of the convolutional neural network (CNN) model.

Deep transfer network for face recognition using 3D synthesized face

Deep Transfer Network with 3D Morphable Models for Face Recognition

Improving RGB-D Face Recognition via Transfer Learning from a Pretrained 2D Network.

Reconstructing A Large Scale 3D Face Dataset for Deep 3D Face Identification

3D Face Recognition Method Based on Deep Convolutional Neural Network

Multi-channel Deep 3D Face Recognition

3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images

Training Deep Face Recognition Systems with Synthetic Data

SynFace: Face Recognition with Synthetic Data

Face Recognition Using Synthetic Face Data

Face Recognition from Sequential Sparse 3D Data Via Deep Registration.

Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks

CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images.

Dfer-net: recognizing facial expression in the wild

Few-Data Guided Learning Upon End-to-End Point Cloud Network for 3D Face Recognition

A fast and robust 3D face recognition approach based on deeply learned face representation.

Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape

Photo-realistic Face Images Synthesis for Learning-based Fine-scale 3D Face Reconstruction.

Learning Effective Intrinsic Features to Boost 3D-Based Face Recognition

Data-Free Point Cloud Network for 3D Face Recognition

Deep Unsupervised Domain Adaptation for Face Recognition