Abstract:Recently, a lot of attention has been focused on the incorporation of 3D data into face analysis and its applications. Despite providing a more accurate representation of the face, 3D facial images are more complex to acquire than 2D pictures. As a consequence, great effort has been invested in developing systems that reconstruct 3D faces from an uncalibrated 2D image. However, the 3D-from-2D face reconstruction problem is ill-posed, thus prior knowledge is needed to restrict the solutions space. In this work, we review 3D face reconstruction methods proposed in the last decade, focusing on those that only use 2D pictures captured under uncontrolled conditions. We present a classification of the proposed methods based on the technique used to add prior knowledge, considering three main strategies, namely, statistical model fitting, photometry, and deep learning, and reviewing each of them separately. In addition, given the relevance of statistical 3D facial models as prior knowledge, we explain the construction procedure and provide a list of the most popular publicly available 3D facial models. After the exhaustive study of 3D-from-2D face reconstruction approaches, we observe that the deep learning strategy is rapidly growing since the last few years, becoming the standard choice in replacement of the widespread statistical model fitting. Unlike the other two strategies, photometry-based methods have decreased in number due to the need for strong underlying assumptions that limit the quality of their reconstructions compared to statistical model fitting and deep learning methods. The review also identifies current challenges and suggests avenues for future research.

Single-View 3D reconstruction: A Survey of deep learning methods

Deep learning-based 3D reconstruction: a survey

3D Reconstruction Using Deep Learning: a Survey.

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

3D Face Reconstruction in Deep Learning Era: A Survey

Deep-Learning-Based 3-D Surface Reconstruction—A Survey

Learning-based Multi-View Stereo: A Survey

Deep Learning for Multi-View Stereo via Plane Sweep: A Survey

3D Reconstruction From Traditional Methods to Deep Learning

Deep Learning for 3D Reconstruction, Augmentation, and Registration: A Review Paper

A Comprehensive Review of Vision-Based 3D Reconstruction Methods

Multi-view stereo in the Deep Learning Era: A comprehensive revfiew

Survey on Fundamental Deep Learning 3D Reconstruction Techniques

Three-Dimensional Dense Reconstruction: A Review of Algorithms and Datasets

3D Face Reconstruction Based on A Single Image: A Review

Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views

Multi-view stereo in the Deep Learning Era: A comprehensive review

Survey on 3D face reconstruction from uncalibrated images

A review of 3D reconstruction methods based on deep learning

A Survey of Image-Based Few-Shot 3D Reconstruction

3 Dimensional Dense Reconstruction: A Review of Algorithms and Dataset