Abstract:Facial landmarking is a fundamental step in machine-based face analysis. The majority of existing techniques handle such an issue based on 2D images; however, they suffer from illumination and pose variations that largely degrade landmarking performance. The emergence of 3D data provides us with an alternative to overcome these unsolved problems in the 2D domain. This paper proposes a novel approach to 3D facial landmarking, combining both the advantages of feature based methods as well as model based ones in a coarse-to-fine manner. For the coarse stage, three fiducial landmarks (the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further employed to initialize the subsequent model fitting. For the fine stage, a statistical model is constructed based on the normal information including the x, y, and z components of the facial point-cloud rather than the smooth coordinate information, thereby namely Active Normal Model (ANM), to highlight its shape characteristics for final landmark prediction. The proposed approach accurately localizes 83 fiducial points on each 3D face model, greatly surpassing those of feature based ones, while improving the state of the art model based ones in two aspects, i.e. sensitivity to initialization and deficiency in discrimination. Evaluated on the BU-3DFE database, very competitive results are achieved in comparison with those in the literature, clearly demonstrating its effectiveness.

Face Boundary Extraction By Statistical Constraint Active Contour Model

Face Contour Extraction Algorithm Based on Skin Luma and Depth Information

Facial Features Extraction Based on Active Shape Model.

Geometric Active Contours for Face Contour Extraction

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Face recognition with contiguous occlusion using linear regression and level set method

Fast face modeling based on features and flexible mesh model

Face contour extraction using level sets

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Face contour detection using geometric active contours

Neighborhood Aided Implicit Active Contours

An Effective Approach to Chin Contour Extraction.

Neighbor-constrained Active Contours Without Edges.

Feature Level Analysis for 3D Facial Expression Recognition.

Look at Boundary: A Boundary-Aware Face Alignment Algorithm

Probabilistic approach to facial feature extraction based on statistical shape models

Feature Representation for Facial Expression Recognition Based on FACS and LBP

Constraint Shape Model Using Edge Constraint and Gabor Wavelet Based Search

Facial Landmark Detection under Large Pose

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Incorporating Prior Shape Into Geometric Active Contours For Face Contour Detection