Abstract:Facial landmark detection is to localize multiple facial key-points for a given facial image. While many methods have achieved remarkable performance in recent years, the accuracy remains unsatisfactory due to some uncontrolled conditions such as occlusion, head pose variations and illumination, under which, the L2 loss function is conventionally dominated by errors from those facial components on which the landmarks are hard predicted. In this paper, a novel branched convolutional neural network incorporated with Jacobian deep regression framework, hereafter referred to as BCNN-JDR, is proposed to solve the facial landmark detection problem. Our proposed framework consists of two parts: initialization stage and cascaded refinement stages. We firstly exploit branched convolutional neural networks as the robust initializer to estimate initial shape, which is incorporated with the knowledge of component-aware branches. By virtue of the component-aware branches mechanism, BCNN can effectively alleviate this issue of the imbalance errors among facial components and provide the robust initial face shape. Following the BCNN, a sequence of refinement stages are cascaded to fine-tune the initial shape within a narrow range. In each refinement stage, the local texture information is adopted to fit the facial local nonlinear variation. Moreover, our entire framework is jointly optimized via the Jacobian deep regression optimization strategy in an end-to-end manner. Jacobian deep regression optimization strategy has an ability to backward propagate the training error of the last stage to all previous stages, which implements a global optimization approach to our proposed framework. Experimental results on benchmark datasets demonstrate that the proposed BCNN-JDR is robust against uncontrolled conditions and outperforms the state-of-the-art approaches.

Coupled Cascade Regression For Simultaneous Facial Landmark Detection And Head Pose Estimation

Coupled cascade regression from real and synthesized faces for simultaneous landmark detection and head pose estimation

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Cascade of Forests for Face Alignment

Cross-Cascading Regression for Simultaneous Head Pose Estimation and Facial Landmark Detection.

Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection

Dual Sparse Constrained Cascade Regression for Robust Face Alignment.

Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

Facial Landmark Detection under Large Pose

Facial landmark localization based on hierarchical pose regression with cascaded random ferns.

Joint Head Pose and Facial Landmark Regression from Depth Images

Robust Facial Landmark Localization Based on Two-Stage Cascaded Pose Regression

Cascade Learning for Driver Facial Monitoring.

Adaptive Cascade Regression Model for Robust Face Alignment.

A Multi-Task Collaborative Learning Method Based on Auxiliary Training and Geometric Constraints

Face Alignment via Multi-Regressors Collaborative Optimization.

Facial Landmark Detection Via Cascade Multi-Channel Convolutional Neural Network

Accurate Landmarking from 3D Facial Scans by CNN and Cascade Regression.

Robust Facial Landmark Detection Based On Initializing Multiple Poses

Branched Convolutional Neural Networks Incorporated with Jacobian Deep Regression for Facial Landmark Detection.

On 3D Face Reconstruction via Cascaded Regression in Shape Space