Abstract:Deep learning methods have brought many breakthroughs to computer vision, especially in 2D face recognition. However, the bottleneck of deep learning based 3D face recognition is that it is difficult to collect millions of 3D faces, whether for industry or academia. In view of this situation, there are many methods to generate more 3D faces from existing 3D faces through 3D face data augmentation, which are used to train deep 3D face recognition models. However, to the best of our knowledge, there is no method to generate 3D faces from 2D face images for training deep 3D face recognition models. This letter focuses on the role of reconstructed 3D facial surfaces in 3D face identification and proposes a framework of 2D-aided deep 3D face identification. In particular, we propose to reconstruct millions of 3D face scans from a large scale 2D face database (i.e.VGGFace2), using a deep learning based 3D face reconstruction method (<a class="link-external link-http" href="http://i.e.ExpNet" rel="external noopener nofollow">this http URL</a>). Then, we adopt a two-phase training approach: In the first phase, we use millions of face images to pre-train the deep convolutional neural network (DCNN), and in the second phase, we use normal component images (NCI) of reconstructed 3D face scans to train the DCNN. Extensive experimental results illustrate that the proposed approach can greatly improve the rank-1 score of 3D face identification on the FRGC v2.0, the Bosphorus, and the BU-3DFE 3D face databases, compared to the model trained by 2D face images. Finally, our proposed approach achieves state-of-the-art rank-1 scores on the FRGC v2.0 (97.6%), Bosphorus (98.4%), and BU-3DFE (98.8%) databases. The experimental results show that the reconstructed 3D facial surfaces are useful and our 2D-aided deep 3D face identification framework is meaningful, facing the scarcity of 3D faces.

Deeply Learned Pore-Scale Facial Features with a Large Pore-to-pore Correspondences Dataset.

Pore-Scale Facial Features Matching Under 3D Morphable Model Constraint.

Design and learn distinctive features from pore-scale facial keypoints

High-Quality Facial Keypoints Matching With Motion Smoothness Constraint And 3d Model Constraint

Palmprint and Palmvein Recognition Based on DCNN and A New Large-Scale Contactless Palmvein Dataset

High-Resolution Face Verification Using Pore-Scale Facial Features

Deep Face Feature for Face Alignment

Deep Face Feature for Face Alignment and Reconstruction.

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

Weakly Supervised Fingerprint Pore Extraction with Convolutional Neural Network

Reconstructing A Large Scale 3D Face Dataset for Deep 3D Face Identification

Learning from Millions of 3D Scans for Large-scale 3D Face Recognition

Find Dense Correspondence between High Resolution Non-rigid 3D Human Faces.

Joint 3d Face Reconstruction And Dense Face Alignment Via Deep Face Feature Alignment

Nose Pore Recognition Based on Discriminant Locality Preserving Projections

Patch Attention Layer of Embedding Handcrafted Features in CNN for Facial Expression Recognition

Targeting Ultimate Accuracy: Face Recognition via Deep Embedding

Deep Feature Matching for Dense Correspondence

Unsupervised Domain Adaptation for Cross-sensor Pore Detection in High-resolution Fingerprint Images

Subcutaneous Sweat Pore Estimation from Optical Coherence Tomography