Abstract:We present TED-Face, a new method for recovering high-fidelity 3D facial geometry and appearance with enhanced textures from single-view images. While vision-based face reconstruction has received intensive research in the past decades due to its broad applications, it remains a challenging problem because human eyes are particularly sensitive to numerically minute yet perceptually significant details. Previous methods that seek to minimize reconstruction errors within a low-dimensional face space can suffer from this issue and generate close yet low-fidelity approximations. The loss of high-frequency texture details is a key factor in their process, which we propose to address by learning to recover both dense radiance residuals and sparse facial texture features from a single image, in addition to the variables solved by previous work—shape, appearance, illumination, and camera. We integrate the estimation of all these factors in a single unified deep neural network and train it on several popular face reconstruction datasets. We also introduce two new metrics, visual fidelity (VIF) and structural similarity (SSIM), to compensate for the fact that reconstruction error is not a consistent perceptual metric of quality. On the popular FaceWarehouse facial reconstruction benchmark, our proposed system achieves a VIF score of 0.4802 and an SSIM score of 0.9622, improving over the state-of-the-art Deep3D method by 6.69% and 0.86%, respectively. On the widely used LS3D-300W dataset, we obtain a VIF score of 0.3922 and an SSIM score of 0.9079 for indoor images, and the scores for outdoor images are 0.4100 and 0.9160, respectively, which also represent an improvement over those of Deep3D. These results show that our method is able to recover visually more realistic facial appearance details compared with previous methods.

Improving Face Detection Performance with 3D-Rendered Synthetic Data

Object Features and Face Detection Performance: Analyses with 3D-Rendered Synthetic Data

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face Recognition Using Synthetic Face Data

If It's Not Enough, Make It So: Reducing Authentic Data Demand in Face Recognition through Synthetic Faces

ASFD: Automatic and Scalable Face Detector

Can Synthetic Faces Undo the Damage of Dataset Bias to Face Recognition and Facial Landmark Detection?

Improving Face Anti-Spoofing by 3D Virtual Synthesis

Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset

SynFace: Face Recognition with Synthetic Data

3D-Aware Facial Landmark Detection Via Multi-View Consistent Training on Synthetic Data

Aug3D-RPN: Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth

Data Augmentation for Face Recognition

Improving Object Detector Training on Synthetic Data by Starting With a Strong Baseline Methodology

Synthetic Data for Face Recognition: Current State and Future Prospects

TCDiff: Triple Condition Diffusion Model with 3D Constraints for Stylizing Synthetic Faces

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

TED-Face: Texture-Enhanced Deep Face Reconstruction in the Wild

Optimization of a Training Set for More Robust Face Detection

3D-Aware Adversarial Makeup Generation for Facial Privacy Protection

3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images