Abstract:Facial landmarking is a fundamental task in automatic machine-based face analysis. The majority of existing techniques for such a problem are based on 2D images; however, they suffer from illumination and pose variations that may largely degrade landmarking performance. The emergence of 3D data theoretically provides an alternative to overcome these weaknesses in the 2D domain. This article proposes a novel approach to 3D facial landmarking, which combines both the advantages of feature-based methods as well as model-based ones in a progressive three-stage coarse-to-fine manner (initial, intermediate, and fine stages). For the initial stage, a few fiducial landmarks (i.e., the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further exploited to initialize the subsequent stage. For the intermediate stage, a statistical model is learned in the feature space of three normal components of the facial point-cloud rather than the smooth original coordinates, namely Active Normal Model (ANM). For the fine stage, cascaded regression is employed to locally refine the landmarks according to their geometry attributes. The proposed approach can accurately localize dozens of fiducial points on each 3D face scan, greatly surpassing the feature-based ones, and it also improves the state of the art of the model-based ones in two aspects: sensitivity to initialization and deficiency in discrimination. The proposed method is evaluated on the BU-3DFE, Bosphorus, and BU-4DFE databases, and competitive results are achieved in comparison with counterparts in the literature, clearly demonstrating its effectiveness.

A robust facial landmark detection method in multi-views

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Face Sketch Landmarks Localization in the Wild

An Automatic System For Multi-View Face Detection And Pose Estimation

Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment

Robust Facial Landmark Detection and Tracking Across Poses and Expressions for In-the-wild Monocular Video

Multiview Facial Landmark Localization in RGB-D Images Via Hierarchical Regression with Binary Patterns.

Multi-View Exclusive Unsupervised Dimension Reduction for Video-Based Facial Expression Recognition

Robust Facial Landmark Detection Based On Initializing Multiple Poses

A statistic-based approach for automatic multi-view face detection and pose estimation

Facial Landmark Detection under Large Pose

Multi-View Facial Expression Recognition Based on Group Sparse Reduced-Rank Regression

Joint Multi-View Face Alignment in the Wild

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Extra Facial Landmark Localization Via Global Shape Reconstruction.

A New Method for Facial Landmarks Detection

A Robust Facial Landmark Detector with Mixed Loss

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

Facial Component-Landmark Detection with Weakly-Supervised LR-CNN.