Abstract:Facial landmarking is a fundamental task in automatic machine-based face analysis. The majority of existing techniques for such a problem are based on 2D images; however, they suffer from illumination and pose variations that may largely degrade landmarking performance. The emergence of 3D data theoretically provides an alternative to overcome these weaknesses in the 2D domain. This article proposes a novel approach to 3D facial landmarking, which combines both the advantages of feature-based methods as well as model-based ones in a progressive three-stage coarse-to-fine manner (initial, intermediate, and fine stages). For the initial stage, a few fiducial landmarks (i.e., the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further exploited to initialize the subsequent stage. For the intermediate stage, a statistical model is learned in the feature space of three normal components of the facial point-cloud rather than the smooth original coordinates, namely Active Normal Model (ANM). For the fine stage, cascaded regression is employed to locally refine the landmarks according to their geometry attributes. The proposed approach can accurately localize dozens of fiducial points on each 3D face scan, greatly surpassing the feature-based ones, and it also improves the state of the art of the model-based ones in two aspects: sensitivity to initialization and deficiency in discrimination. The proposed method is evaluated on the BU-3DFE, Bosphorus, and BU-4DFE databases, and competitive results are achieved in comparison with counterparts in the literature, clearly demonstrating its effectiveness.

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Automatic landmark annotation and dense correspondence registration for 3D human facial images

Joint Voxel and Coordinate Regression for Accurate 3D Facial Landmark Localization

Learning-based local-to-global landmark annotation for automatic 3D cephalometry

Accurate Landmarking from 3D Facial Scans by CNN and Cascade Regression.

Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model.

On 3D Face Reconstruction via Cascaded Regression in Shape Space

Cascaded Regression using Landmark Displacement for 3D Face Reconstruction

Joint 3D Face Reconstruction and Dense Face Alignment from A Single Image with 2D-Assisted Self-Supervised Learning

A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks

Automatic Detection of Craniomaxillofacial Anatomical Landmarks on CBCT Images Using 3D Mask R-CNN.

3D Face Reconstruction From A Single Image Assisted by 2D Face Images in the Wild

Feature Fusion Based Constrained Local Model for Three-Dimensional Facial Landmark Localization

A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion

Single View 3D Face Reconstruction with Landmark Updating

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning