Abstract:Recently, heatmap regression has been widely explored in facial landmark detection and obtained remarkable performance. However, most of the existing heatmap regression-based facial landmark detection methods neglect to explore the high-order feature correlations, which is very important to learn more representative features and enhance shape constraints. Moreover, no explicit global shape constraints have been added to the final predicted landmarks, which leads to a reduction in accuracy. To address these issues, in this paper, we propose a Multi-order Multi-constraint Deep Network (MMDN) for more powerful feature correlations and shape constraints learning. Specifically, an Implicit Multi-order Correlating Geometry-aware (IMCG) model is proposed to introduce the multi-order spatial correlations and multi-order channel correlations for more discriminative representations. Furthermore, an Explicit Probability-based Boundary-adaptive Regression (EPBR) method is developed to enhance the global shape constraints and further search the semantically consistent landmarks in the predicted boundary for robust facial landmark detection. It's interesting to show that the proposed MMDN can generate more accurate boundary-adaptive landmark heatmaps and effectively enhance shape constraints to the predicted landmarks for faces with large pose variations and heavy occlusions. Experimental results on challenging benchmark datasets demonstrate the superiority of our MMDN over state-of-the-art facial landmark detection methods. The code has been publicly available at <a class="link-external link-https" href="https://github.com/junwan2014/MMDN-master" rel="external noopener nofollow">this https URL</a>.

Geometry-attentive relational reasoning for robust facial landmark detection

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Deep Geometry Embedding Networks for Robust Facial Landmark Detection.

Geometry-Aware Facial Expression Recognition Via Attentive Graph Convolutional Networks

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Leveraging Geometric Correlation For Input-Adaptive Facial Landmark Regression

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Automatic landmark detection for high resolution non-rigid 3D faces based on geometric information

Attentive Occlusion-Adaptive Deep Network for Facial Landmark Detection.

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

Facial Landmark Detection Via Attention-Adaptive Deep Network.

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Learning efficient facial landmark model for human attractiveness analysis

Reasoning structural relation for occlusion-robust facial landmark localization

Facial Landmark Detection under Large Pose

Towards Unconstrained Facial Landmark Detection Robust to Diverse Cropping Manners.

Feature Fusion Based Constrained Local Model for Three-Dimensional Facial Landmark Localization

3-D Facial Landmarks Detection for Intelligent Video Systems

Extra Facial Landmark Localization Via Global Shape Reconstruction.

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment