Abstract:Facial landmarking is a fundamental task in automatic machine-based face analysis. The majority of existing techniques for such a problem are based on 2D images; however, they suffer from illumination and pose variations that may largely degrade landmarking performance. The emergence of 3D data theoretically provides an alternative to overcome these weaknesses in the 2D domain. This article proposes a novel approach to 3D facial landmarking, which combines both the advantages of feature-based methods as well as model-based ones in a progressive three-stage coarse-to-fine manner (initial, intermediate, and fine stages). For the initial stage, a few fiducial landmarks (i.e., the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further exploited to initialize the subsequent stage. For the intermediate stage, a statistical model is learned in the feature space of three normal components of the facial point-cloud rather than the smooth original coordinates, namely Active Normal Model (ANM). For the fine stage, cascaded regression is employed to locally refine the landmarks according to their geometry attributes. The proposed approach can accurately localize dozens of fiducial points on each 3D face scan, greatly surpassing the feature-based ones, and it also improves the state of the art of the model-based ones in two aspects: sensitivity to initialization and deficiency in discrimination. The proposed method is evaluated on the BU-3DFE, Bosphorus, and BU-4DFE databases, and competitive results are achieved in comparison with counterparts in the literature, clearly demonstrating its effectiveness.

Real-time Accurate Facial Feature Corner Localization by Rule-Based Selection.

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

A Method for Accurate Localization of Facial Features

An Improved Fast SUSAN Chessboard Corner Detection Algorithm

Real-time Localization of 3D Facial Landmarks

3D facial landmark localization via a local surface descriptor HoSNI

Eye Corner Detection with Texture Image Fusion.

Automatic localization of the corners of eyes on human faces

Accurate Iocalization of Facial Feature Points Based on Random Forest Classifier

Efficient Object Recognition Using Corner Features

Robust 3D Face Recognition by Local Shape Difference Boosting

Automatic Localization of the Vital Feature Points on Human Faces

Rapid Adaptive Rsusan Algorithm Of Corner Detection

Real Time Detection of Eye Corners and Iris Center from Images Acquired by Usual Camera

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

A New Fast and Robust Corner Detection Algorithm

RCDN -- Robust X-Corner Detection Algorithm based on Advanced CNN Model

Inner and Outer Eye Corners Detection for Facial Features Extraction Based on CTGF Algorithm

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

A Robust Facial Feature Points Location Algorithm under Variable Illumination