Abstract:Recently, heatmap regression has been widely explored in facial landmark detection and obtained remarkable performance. However, most of the existing heatmap regression-based facial landmark detection methods neglect to explore the high-order feature correlations, which is very important to learn more representative features and enhance shape constraints. Moreover, no explicit global shape constraints have been added to the final predicted landmarks, which leads to a reduction in accuracy. To address these issues, in this paper, we propose a Multi-order Multi-constraint Deep Network (MMDN) for more powerful feature correlations and shape constraints learning. Specifically, an Implicit Multi-order Correlating Geometry-aware (IMCG) model is proposed to introduce the multi-order spatial correlations and multi-order channel correlations for more discriminative representations. Furthermore, an Explicit Probability-based Boundary-adaptive Regression (EPBR) method is developed to enhance the global shape constraints and further search the semantically consistent landmarks in the predicted boundary for robust facial landmark detection. It's interesting to show that the proposed MMDN can generate more accurate boundary-adaptive landmark heatmaps and effectively enhance shape constraints to the predicted landmarks for faces with large pose variations and heavy occlusions. Experimental results on challenging benchmark datasets demonstrate the superiority of our MMDN over state-of-the-art facial landmark detection methods. The code has been publicly available at <a class="link-external link-https" href="https://github.com/junwan2014/MMDN-master" rel="external noopener nofollow">this https URL</a>.

Learning the Face Shape Models for Facial Landmark Detection in the Wild.

Bayesian Shape Localization for Face Recognition Using Global and Local Textures.

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Face Sketch Landmarks Localization in the Wild

A Hierarchical Probabilistic Model for Facial Feature Detection

Facial Feature Tracking under Varying Facial Expressions and Face Poses based on Restricted Boltzmann Machines

Reconstructing Recognizable 3D Face Shapes Based on 3D Morphable Models.

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

Hierarchical Facial Landmark Localization Via Cascaded Random Binary Patterns

Joint Multi-View Face Alignment in the Wild

Robust Face Recognition by Constrained Part-based Alignment.

Learning Robust Facial Landmark Detection Via Hierarchical Structured Ensemble

A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose

Deep Structured Prediction for Facial Landmark Detection

Hierarchical Shape Modeling for Automatic Face Localization

Joint Head Pose and Facial Landmark Regression from Depth Images

Facial Landmark Detection: a Literature Survey

Multiview Facial Landmark Localization in RGB-D Images Via Hierarchical Regression with Binary Patterns.