Abstract:International Journal of Computational Intelligence and Applications, Ahead of Print. In view of the problems of high production cost, scarcity and lack of diversity of 3D face datasets, this paper designs an end-to-end self-supervised learning 3D face reconstruction algorithm with a single 2D face image as input, which only uses 2D face datasets to complete model training. First, the improved ResNet module is introduced to preprocess the input face image. The deep residual neural network has strong feature extraction and characterization ability for the image, which can provide rich high-level semantic feature maps for the subsequent subnetwork. Then, add transformer module completely based on self-attention mechanism to the parameter prediction subnetwork, which can make different parameters of the subnetwork focus on self-related feature map information and avoid interference from invalid feature map information, so as to further improve the parameter prediction accuracy of the subnetwork. Next, training, ablation and comparison experiments were conducted on CelebA, BFM and Photoface datasets, and the combined function of pixel loss function and perceptual loss function was selected as the loss function. The experimental results show that: compared with the historical optimal results of the same network structure, the scale-invariant depth error (SIDE) and mean angle deviation (MAD) are improved by 5.9% and 10.8%, respectively, which strongly proves the effectiveness of the algorithm. Finally, in order to verify the actual effect of the 3D face reconstruction algorithm, examples are selected in this paper for reconstruction. The 3D faces generated by the algorithm all have a good sense of reality, which intuitively and effectively proves the advancement of the algorithm.

End-to-End 3D Face Model Reconstruction Method Based on Fusion-CNN

3D Face Reconstruction Based on ResNet Feature Extraction and CBAM

A Face Reconstruction Method Based On Fusion Regression Network And Gradient Descent

3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images

Fast 3D Face Reconstruction from a Single Image Combining Attention Mechanism and Graph Convolutional Network

Dense 3D Face Reconstruction from a Single RGB Image

CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images.

End-to-End 3D Facial Shape Reconstruction from an Unconstrained Image.

Photo-realistic Face Images Synthesis for Learning-based Fine-scale 3D Face Reconstruction.

CRNet:3D Face Reconstruction with Contour Map Regression Network

A Lightweight Network with Multi-Stage Feature Fusion Module for Single-View 3d Face Reconstruction.

Learning-detailed 3D Face Reconstruction Based on Convolutional Neural Networks from a Single Image.

3D face-model reconstruction from a single image: A feature aggregation approach using hierarchical transformer with weak supervision

Transformer-Based 3D Face Reconstruction with End-to-End Shape-Preserved Domain Transfer

3D Face Reconstruction Based on A Single Image: A Review

Review of 3D Face Reconstruction Based on Single Image

3D Face Reconstruction from Light Field Images: A Model-Free Approach

A Lightweight Monocular 3D Face Reconstruction Method Based on Improved 3D Morphing Models.

Learning 3-D Face Shape from Diverse Sources with Cross-Domain Face Synthesis

Research on 3D Face Reconstruction Algorithm Based on ResNet and Transformer

Approach to 3D face reconstruction through local deep feature alignment