Abstract:Facial landmark detection aims at localizing multiple keypoints for a given facial image, which usually suffers from variations caused by arbitrary pose, diverse facial expression and partial occlusion. In this paper, we develop a two-stage regression network for facial landmark detection on unconstrained conditions. Our model consists of a Structural Hourglass Network (SHN) for detecting the initial locations of all facial landmarks based on heatmap generation, and a Global Constraint Network (GCN) for further refining the detected locations based on offset estimation. Specifically, SHN introduces an improved Inception-ResNet unit as basic building block, which can effectively improve the receptive field and learn contextual feature representations. In the meanwhile, a novel loss function with adaptive weight is proposed to make the whole model focus on the hard landmarks precisely. GCN attempts to explore the spatial contextual relationship between facial landmarks and refine the initial locations of facial landmarks by optimizing the global constraint. Moreover, we develop a pre-processing network to generate features with different scales, which will be transmitted to SHN and GCN for effective feature representations. Different from existing models, the proposed method realizes the heatmap-offset framework, which combines the outputs of heatmaps generated by SHN and coordinates estimated by GCN, to obtain an accurate prediction. The extensive experimental results on several challenging datasets, including 300W, COFW, AFLW, and 300-VW confirm that our method achieve competitive performance compared with the state-of-the-art algorithms.

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Attention-Guided Coarse-to-Fine Network for 2D Face Alignment in the Wild

Stack of Heatmap Hourglass Network for Face Alignment

Stacked Attention Hourglass Network Based Robust Facial Landmark Detection

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Joint Head Attribute Classifier and Domain-Specific Refinement Networks for Face Alignment

Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Learning Deformable Hourglass Networks (Dhgn) For Unconstrained Face Alignment

Cascaded Structure-Learning Network with Using Adversarial Training for Robust Facial Landmark Detection

An Improved Boundary-Aware Face Alignment Using Stacked Dense U-Nets

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Deformable Hourglass Network with Face Region Normalization for Robust Face Alignment

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Robust Face Alignment Via Adaptive Attention-Based Graph Convolutional Network

Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction

Improving Human Pose Estimation Based on Stacked Hourglass Network

3-D Facial Landmarks Detection for Intelligent Video Systems

Exemplar-based Cascaded Stacked Auto-Encoder Networks for Robust Face Alignment.