Abstract:Recently, heatmap regression has been widely explored in facial landmark detection and obtained remarkable performance. However, most of the existing heatmap regression-based facial landmark detection methods neglect to explore the high-order feature correlations, which is very important to learn more representative features and enhance shape constraints. Moreover, no explicit global shape constraints have been added to the final predicted landmarks, which leads to a reduction in accuracy. To address these issues, in this paper, we propose a Multi-order Multi-constraint Deep Network (MMDN) for more powerful feature correlations and shape constraints learning. Specifically, an Implicit Multi-order Correlating Geometry-aware (IMCG) model is proposed to introduce the multi-order spatial correlations and multi-order channel correlations for more discriminative representations. Furthermore, an Explicit Probability-based Boundary-adaptive Regression (EPBR) method is developed to enhance the global shape constraints and further search the semantically consistent landmarks in the predicted boundary for robust facial landmark detection. It's interesting to show that the proposed MMDN can generate more accurate boundary-adaptive landmark heatmaps and effectively enhance shape constraints to the predicted landmarks for faces with large pose variations and heavy occlusions. Experimental results on challenging benchmark datasets demonstrate the superiority of our MMDN over state-of-the-art facial landmark detection methods. The code has been publicly available at <a class="link-external link-https" href="https://github.com/junwan2014/MMDN-master" rel="external noopener nofollow">this https URL</a>.

Towards Unconstrained Facial Landmark Detection Robust to Diverse Cropping Manners.

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Face Sketch Landmarks Localization in the Wild

A Robust Facial Landmark Detector with Mixed Loss

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

PFLD: A Practical Facial Landmark Detector.

FreeEnricher: Enriching Face Landmarks Without Additional Cost

Robust and Flexible Landmarks Detection for Uncontrolled Frontal Faces in the Wild

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Facial Landmark Detection under Large Pose

Unconstrained Face Alignment Without Face Detection.

Attention-Based Accurate and Robust Facial Landmark Detector

Robust Facial Landmark Detection and Tracking Across Poses and Expressions for In-the-wild Monocular Video

Robust Facial Landmark Detection Based On Initializing Multiple Poses

Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model

Robust and efficient facial landmark localization

Facial Component-Landmark Detection with Weakly-Supervised LR-CNN.