Abstract:Deep learning methods have brought many breakthroughs to computer vision, especially in 2D face recognition. However, the bottleneck of deep learning based 3D face recognition is that it is difficult to collect millions of 3D faces, whether for industry or academia. In view of this situation, there are many methods to generate more 3D faces from existing 3D faces through 3D face data augmentation, which are used to train deep 3D face recognition models. However, to the best of our knowledge, there is no method to generate 3D faces from 2D face images for training deep 3D face recognition models. This letter focuses on the role of reconstructed 3D facial surfaces in 3D face identification and proposes a framework of 2D-aided deep 3D face identification. In particular, we propose to reconstruct millions of 3D face scans from a large scale 2D face database (i.e.VGGFace2), using a deep learning based 3D face reconstruction method (<a class="link-external link-http" href="http://i.e.ExpNet" rel="external noopener nofollow">this http URL</a>). Then, we adopt a two-phase training approach: In the first phase, we use millions of face images to pre-train the deep convolutional neural network (DCNN), and in the second phase, we use normal component images (NCI) of reconstructed 3D face scans to train the DCNN. Extensive experimental results illustrate that the proposed approach can greatly improve the rank-1 score of 3D face identification on the FRGC v2.0, the Bosphorus, and the BU-3DFE 3D face databases, compared to the model trained by 2D face images. Finally, our proposed approach achieves state-of-the-art rank-1 scores on the FRGC v2.0 (97.6%), Bosphorus (98.4%), and BU-3DFE (98.8%) databases. The experimental results show that the reconstructed 3D facial surfaces are useful and our 2D-aided deep 3D face identification framework is meaningful, facing the scarcity of 3D faces.

Deeply Learned Pore-Scale Facial Features with a Large Pore-to-pore Correspondences Dataset.

Weakly Supervised Fingerprint Pore Extraction with Convolutional Neural Network

Reconstructing A Large Scale 3D Face Dataset for Deep 3D Face Identification

Learning from Millions of 3D Scans for Large-scale 3D Face Recognition

Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition.

Patch Attention Layer of Embedding Handcrafted Features in CNN for Facial Expression Recognition

Targeting Ultimate Accuracy: Face Recognition via Deep Embedding

Subcutaneous Sweat Pore Estimation from Optical Coherence Tomography

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Fingerprint Pore Extraction Using U-Net Based Fully Convolutional Network.

Pixel-Face: A Large-Scale, High-Resolution Benchmark for 3D Face Reconstruction

Touchless palmprint recognition based on 3D Gabor template and block feature refinement

Understanding Beauty via Deep Facial Features

Facial expression recognition method based on deep convolutional neural network combined with improved LBP features

FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

Face Alignment Across Large Poses: A 3D Solution

DeePore: a deep learning workflow for rapid and comprehensive characterization of porous materials

Collaborative Learning Network For Face Attribute Prediction

Personalized Convolution for Face Recognition

UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition