Abstract:In view of the scarcity, high cost and lack of diversity of three-dimensional (3D) face datasets, this paper designs an end-to-end self-supervised learning 3D face reconstruction network, which uses single 2D face image as input. The model bypasses the 3D face datasets and only uses the 2D face datasets for training to achieve high-precision 3D face reconstruction without any 3D face prior. First, the improved ResNet50 feature extraction module is introduced to extract and characterize the input image by deep convolutional network. Then, a lightweight convolutional block attention module is added to the face prediction subnetwork. On the one hand, channel attention extracts different information included in the image, and on the other hand spatial attention finds the location of the information. So, the serialized attention operation could accurately find the features required for different parameter predictions, further improving face reconstruction parameters’ prediction accuracy. Finally, training, ablation and comparison experiments were conducted on CelebFaces Attributes, basel face model and Photoface datasets, and the combined loss function of pixel loss and perception loss was selected. The pixel loss function was calculated at the pixel microscopic level, and the perception loss function was calculated at the image macroscopic convolution level. The combination of the two could complement each other. Compared with the historical optimal results of the same network structure, the scale-invariant depth error and mean angle deviation of the proposed algorithm are improved by 5.2% and 8.2%, respectively. Experimental results strongly prove the effectiveness of the algorithm.

Single Depth Image 3D Face Reconstruction Via Domain Adaptive Learning

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Depth-Based 3D Face Reconstruction and Pose Estimation Using Shape-Preserving Domain Adaptation

3D Face Reconstruction Based on A Single Image: A Review

Self-supervised single-image 3D face reconstruction method based on attention mechanism and attribute refinement

Face Denoising and 3D Reconstruction from A Single Depth Image

Domain Adaptation for Real-World Single View 3D Reconstruction

The face image super-resolution algorithm based on combined representation learning

Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set

3D Face Reconstruction and Semantic Annotation from Single Depth Image

Approach to 3D face reconstruction through local deep feature alignment

Sample Based 3D Face Reconstruction from a Single Frontal Image by Adaptive Locally Linear Embedding

Domain-Adaptive Single-View 3D Reconstruction

Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

3D Face Reconstruction From A Single Image Assisted by 2D Face Images in the Wild

Domain-Adaptive Full-Face Gaze Estimation via Novel-View-Synthesis and Feature Disentanglement

A Self-Supervised Bootstrap Method for Single-Image 3D Face Reconstruction

Feature Sharing Attention 3D Face Reconstruction with Unsupervised Learning from In-the-Wild Photo Collection

3D Face Reconstruction Based on ResNet Feature Extraction and CBAM

Self-Supervised Learning of Domain Invariant Features for Depth Estimation