Abstract:Facial landmarking is a fundamental task in automatic machine-based face analysis. The majority of existing techniques for such a problem are based on 2D images; however, they suffer from illumination and pose variations that may largely degrade landmarking performance. The emergence of 3D data theoretically provides an alternative to overcome these weaknesses in the 2D domain. This article proposes a novel approach to 3D facial landmarking, which combines both the advantages of feature-based methods as well as model-based ones in a progressive three-stage coarse-to-fine manner (initial, intermediate, and fine stages). For the initial stage, a few fiducial landmarks (i.e., the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further exploited to initialize the subsequent stage. For the intermediate stage, a statistical model is learned in the feature space of three normal components of the facial point-cloud rather than the smooth original coordinates, namely Active Normal Model (ANM). For the fine stage, cascaded regression is employed to locally refine the landmarks according to their geometry attributes. The proposed approach can accurately localize dozens of fiducial points on each 3D face scan, greatly surpassing the feature-based ones, and it also improves the state of the art of the model-based ones in two aspects: sensitivity to initialization and deficiency in discrimination. The proposed method is evaluated on the BU-3DFE, Bosphorus, and BU-4DFE databases, and competitive results are achieved in comparison with counterparts in the literature, clearly demonstrating its effectiveness.

Pix2face: Direct 3D Face Model Estimation

Automatic 3D Face Modeling Using 2D Active Appearance Models

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Moulding Humans: Non-parametric 3D Human Shape Estimation from Single Images

3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

Face Pose Estimation Based on 3D Models and Affine Correspondences

On Learning 3D Face Morphable Model from In-the-wild Images

Automatic 3D Face Modeling from Video

FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry

Robust Registration and Geometry Estimation from Unstructured Facial Scans

A lightweight 3D dense facial landmark estimation model from position map data

Simultaneous Face Detection And Head Pose Estimation: A Fast And Unified Framework

3D face reconstruction with dense landmarks

MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction

Extreme 3D Face Reconstruction: Seeing Through Occlusions

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model.

ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations

Self-Adaptive Morphable Model Based Collaborative Multi-View 3d Face Reconstruction in Visual Sensor Network