Abstract:We present TED-Face, a new method for recovering high-fidelity 3D facial geometry and appearance with enhanced textures from single-view images. While vision-based face reconstruction has received intensive research in the past decades due to its broad applications, it remains a challenging problem because human eyes are particularly sensitive to numerically minute yet perceptually significant details. Previous methods that seek to minimize reconstruction errors within a low-dimensional face space can suffer from this issue and generate close yet low-fidelity approximations. The loss of high-frequency texture details is a key factor in their process, which we propose to address by learning to recover both dense radiance residuals and sparse facial texture features from a single image, in addition to the variables solved by previous work—shape, appearance, illumination, and camera. We integrate the estimation of all these factors in a single unified deep neural network and train it on several popular face reconstruction datasets. We also introduce two new metrics, visual fidelity (VIF) and structural similarity (SSIM), to compensate for the fact that reconstruction error is not a consistent perceptual metric of quality. On the popular FaceWarehouse facial reconstruction benchmark, our proposed system achieves a VIF score of 0.4802 and an SSIM score of 0.9622, improving over the state-of-the-art Deep3D method by 6.69% and 0.86%, respectively. On the widely used LS3D-300W dataset, we obtain a VIF score of 0.3922 and an SSIM score of 0.9079 for indoor images, and the scores for outdoor images are 0.4100 and 0.9160, respectively, which also represent an improvement over those of Deep3D. These results show that our method is able to recover visually more realistic facial appearance details compared with previous methods.

High Resolution Face Image Recognition Based on Skin Texture Feature

A new facial feature based on the fusion of texture and shape characteristics

Skin Detection Using Color, Texture and Space Information

Multi-feature Based Integrated Skin Detection Method

Skin detection using color, texture and neighborhood information

Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation

A high precision feature based on LBP and Gabor theory for face recognition

Face recognition with the robust feature extracted by the generalized Foley-Sammon transform

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Face Detection and Tracking Based on Skin Color and Structure Feature

TED-Face: Texture-Enhanced Deep Face Reconstruction in the Wild

An Enhanced LBP Feature Based on Facial Expression Recognition

Algorithm for Detecting Human Face and Locating Feature under the Complex Background

Face Verification System Based on Texture Feature with Single Sample Per Person

Image Ratio Features for Facial Expression Recognition Application

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

Real-time Segmentation and Facial Skin Tones Grading

Multi-resolution histograms of local variation patterns (MHLVP) for robust face recognition

Facial Expression Recognition System Based on Multiple Feature Integration

Face detection and location based on skin chrominance and lip chrominance transformation from color images

Reflectance Spectra Based Skin And Non-Skin Classification