Abstract:Facial landmarking is a fundamental task in automatic machine-based face analysis. The majority of existing techniques for such a problem are based on 2D images; however, they suffer from illumination and pose variations that may largely degrade landmarking performance. The emergence of 3D data theoretically provides an alternative to overcome these weaknesses in the 2D domain. This article proposes a novel approach to 3D facial landmarking, which combines both the advantages of feature-based methods as well as model-based ones in a progressive three-stage coarse-to-fine manner (initial, intermediate, and fine stages). For the initial stage, a few fiducial landmarks (i.e., the nose tip and two inner eye corners) are robustly detected through curvature analysis, and these points are further exploited to initialize the subsequent stage. For the intermediate stage, a statistical model is learned in the feature space of three normal components of the facial point-cloud rather than the smooth original coordinates, namely Active Normal Model (ANM). For the fine stage, cascaded regression is employed to locally refine the landmarks according to their geometry attributes. The proposed approach can accurately localize dozens of fiducial points on each 3D face scan, greatly surpassing the feature-based ones, and it also improves the state of the art of the model-based ones in two aspects: sensitivity to initialization and deficiency in discrimination. The proposed method is evaluated on the BU-3DFE, Bosphorus, and BU-4DFE databases, and competitive results are achieved in comparison with counterparts in the literature, clearly demonstrating its effectiveness.

Landmark-Based Facial Feature Construction and Action Unit Intensity Prediction

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Robust Facial Landmark Detection Based On Initializing Multiple Poses

Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model.

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Facial Expression Recognition Based on Facial Action Unit

A Robust Real-Time System for Multi-Intensity AU Detection in Facial Expression Recognition

3-D Facial Landmarks Detection for Intelligent Video Systems

Facial Action Unit Detection using 3D Facial Landmarks

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

FAST FACIAL LANDMARK DETECTION USING CASCADE CLASSIFIERS AND A SIMPLE 3D MODEL

An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning

A Deep Regression Architecture with Two-Stage Re-initialization for High Performance Facial Landmark Detection.

Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer

Facial Action Unit Detection Using Attention and Relation Learning

Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment

CenterFace: Joint Face Detection and Alignment Using Face As Point.

Simultaneous Facial Feature Tracking and Facial Expression Recognition.

Facial Landmark Detection under Large Pose

Semi Supervised Unconstrained Action Unit Detection via Latent Feature Domain