Abstract:Recently, a lot of attention has been focused on the incorporation of 3D data into face analysis and its applications. Despite providing a more accurate representation of the face, 3D facial images are more complex to acquire than 2D pictures. As a consequence, great effort has been invested in developing systems that reconstruct 3D faces from an uncalibrated 2D image. However, the 3D-from-2D face reconstruction problem is ill-posed, thus prior knowledge is needed to restrict the solutions space. In this work, we review 3D face reconstruction methods proposed in the last decade, focusing on those that only use 2D pictures captured under uncontrolled conditions. We present a classification of the proposed methods based on the technique used to add prior knowledge, considering three main strategies, namely, statistical model fitting, photometry, and deep learning, and reviewing each of them separately. In addition, given the relevance of statistical 3D facial models as prior knowledge, we explain the construction procedure and provide a list of the most popular publicly available 3D facial models. After the exhaustive study of 3D-from-2D face reconstruction approaches, we observe that the deep learning strategy is rapidly growing since the last few years, becoming the standard choice in replacement of the widespread statistical model fitting. Unlike the other two strategies, photometry-based methods have decreased in number due to the need for strong underlying assumptions that limit the quality of their reconstructions compared to statistical model fitting and deep learning methods. The review also identifies current challenges and suggests avenues for future research.

Fast 3D face reconstruction based on uncalibrated photometric stereo

A synthesis method for personalized 3D face reconstruction

A Simple 3D Reconstruction Method Based on Single Camera

From Stereo Pair to 3D Face Model

3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights

Contactless 3D Fingerprint Identification Without 3D Reconstruction.

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

A Fast 3d Face Reconstruction Method From A Single Image Using Adjustable Model

A Model Based Method for Stereo Face Reconstruction

Dense 3D Reconstruction Based on Photometric Stereo with Unknown Light Source via Energy Minimization Framework

Accurate And Efficient Reconstruction Of 3d Faces From Stereo Images

Realistic Reconstruction of Human Face Based on Images

A Robust and Fast 3D Face Reconstruction Method Using Realsense Camera

Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Robust Geometry and Reflectance Disentanglement for 3D Face Reconstruction from Sparse-view Images

Efficient Photometric Stereo Using Kernel Regression

Three-Dimensional Reconstruction from Single Image Base on Combination of CNN and Multi-Spectral Photometric Stereo

Self-calibrating Photometric Stereo by Neural Inverse Rendering

A Self-Calibrated Photo-Geometric Depth Camera

Survey on 3D face reconstruction from uncalibrated images