Abstract:In view of the scarcity, high cost and lack of diversity of three-dimensional (3D) face datasets, this paper designs an end-to-end self-supervised learning 3D face reconstruction network, which uses single 2D face image as input. The model bypasses the 3D face datasets and only uses the 2D face datasets for training to achieve high-precision 3D face reconstruction without any 3D face prior. First, the improved ResNet50 feature extraction module is introduced to extract and characterize the input image by deep convolutional network. Then, a lightweight convolutional block attention module is added to the face prediction subnetwork. On the one hand, channel attention extracts different information included in the image, and on the other hand spatial attention finds the location of the information. So, the serialized attention operation could accurately find the features required for different parameter predictions, further improving face reconstruction parameters’ prediction accuracy. Finally, training, ablation and comparison experiments were conducted on CelebFaces Attributes, basel face model and Photoface datasets, and the combined loss function of pixel loss and perception loss was selected. The pixel loss function was calculated at the pixel microscopic level, and the perception loss function was calculated at the image macroscopic convolution level. The combination of the two could complement each other. Compared with the historical optimal results of the same network structure, the scale-invariant depth error and mean angle deviation of the proposed algorithm are improved by 5.2% and 8.2%, respectively. Experimental results strongly prove the effectiveness of the algorithm.

Face Denoising and 3D Reconstruction from A Single Depth Image

Depth-Based 3D Face Reconstruction and Pose Estimation Using Shape-Preserving Domain Adaptation

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

3D Face Reconstruction and Semantic Annotation from Single Depth Image

Robust 3d Face Reconstruction From Single Noisy Depth Image Through Semantic Consistency

Toward 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose From Monocular Image

Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set

3D Face Reconstruction Based on ResNet Feature Extraction and CBAM

CRNet:3D Face Reconstruction with Contour Map Regression Network

3D Face Reconstruction Using A Spectral-Based Graph Convolution Encoder

Recognition-oriented facial depth estimation from a single image

Ddrnet: Depth Map Denoising And Refinement For Consumer Depth Cameras Using Cascaded Cnns

Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment

Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

Single Depth Image 3D Face Reconstruction Via Domain Adaptive Learning

Unsupervised Style-based Explicit 3D Face Reconstruction from Single Image

3D Face Reconstruction Based on A Single Image: A Review

Learning Semantic Representations via Joint 3D Face Reconstruction and Facial Attribute Estimation

Feature Sharing Attention 3D Face Reconstruction with Unsupervised Learning from In-the-Wild Photo Collection

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction