Abstract:Data augmentation using 3D face models to synthesize faces has been demonstrated to be effective for face recognition. However, the model directly trained by using the synthesized faces together with the original real faces is not optimal. In this paper, we propose a novel approach that uses a deep transfer network (DTN) with 3D morphable models (3DMMs) for face recognition to overcome the shortage of labeled face images and the dataset bias between synthesized images and corresponding real images. We first utilize the 3DMM to synthesize faces with various poses to augment the training dataset. Then, we train a deep neural network using the synthesized face images and the original real face images. The results obtained on LFW show that the accuracy of the model utilizing synthesized data only is lower than that of the model using the original data, although the synthesized dataset contains much considerably images with more unconstrained poses. This result shows that a dataset bias exists between the synthesized faces and the real faces. We treat the synthesized faces as the source domain, and we treat the actual faces as the target domain. We use the DTN to alleviate the discrepancy between the source domain and the target domain. The DTN attempts to project source domain samples and target domain samples to a new space where they are fused together such that one cannot distinguish the domain from which a specific image is from. We optimize our DTN based on the maximum mean discrepancy (MMD) of the shared feature extraction layers and the discrimination layers. We choose AlexNet and Inception-ResNet-V1 as our benchmark models. The proposed method is also evaluated on the LFW and SLLFW databases. The experimental results show that our method can effectively address the domain discrepancy. Moreover, the dataset bias between the synthesized data and the real data is remarkably reduced, which can thus improve the performance of the convolutional neural network (CNN) model.

Video-Based Disguise Face Recognition Based On Deep Spiking Neural Network

Deep Spiking Neural Network for Video-Based Disguise Face Recognition Based on Dynamic Facial Movements.

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

The Devil is in the Detail: Deep Feature Based Disguised Face Recognition Method

Face Anti-Spoofing Via Jointly Modeling Local Texture and Constructed Depth

Bio-Inspired Spiking Neural Networks for Facial Expression Recognition - Generalisation Investigation.

Deep Representations Based on Sparse Auto-Encoder Networks for Face Spoofing Detection.

NSNP-DFER: A Nonlinear Spiking Neural P Network for Dynamic Facial Expression Recognition

Video-based Face Recognition Based on Deep Convolutional Neural Network

STIDNet: Identity-Aware Face Forgery Detection with Spatiotemporal Knowledge Distillation

Video-based Face Recognition Via Convolutional Neural Networks

Deep transfer network for face recognition using 3D synthesized face

Deep Convolutional Neural Network Used in Single Sample per Person Face Recognition

Face Spoofing Detection Based on Multi-Scale Color Inversion Dual-Stream Convolutional Neural Network

Dynamic Difference Learning with Spatio-temporal Correlation for Deepfake Video Detection

Deep Transfer Network with 3D Morphable Models for Face Recognition

Stacking-based Deep Neural Network for Facial Expression Recognition

Face Anti-Spoofing with Local Difference Network and Binary Facial Mask Supervision

Face Anti-Spoofing Using Spatial Pyramid Pooling

Deepfake Videos Detection Based on Image Segmentation with Deep Neural Networks

3D Face Mask Anti-spoofing Via Deep Fusion of Dynamic Texture and Shape Clues