Abstract:Facial landmark detection aims at localizing multiple keypoints for a given facial image, which usually suffers from variations caused by arbitrary pose, diverse facial expression and partial occlusion. In this paper, we develop a two-stage regression network for facial landmark detection on unconstrained conditions. Our model consists of a Structural Hourglass Network (SHN) for detecting the initial locations of all facial landmarks based on heatmap generation, and a Global Constraint Network (GCN) for further refining the detected locations based on offset estimation. Specifically, SHN introduces an improved Inception-ResNet unit as basic building block, which can effectively improve the receptive field and learn contextual feature representations. In the meanwhile, a novel loss function with adaptive weight is proposed to make the whole model focus on the hard landmarks precisely. GCN attempts to explore the spatial contextual relationship between facial landmarks and refine the initial locations of facial landmarks by optimizing the global constraint. Moreover, we develop a pre-processing network to generate features with different scales, which will be transmitted to SHN and GCN for effective feature representations. Different from existing models, the proposed method realizes the heatmap-offset framework, which combines the outputs of heatmaps generated by SHN and coordinates estimated by GCN, to obtain an accurate prediction. The extensive experimental results on several challenging datasets, including 300W, COFW, AFLW, and 300-VW confirm that our method achieve competitive performance compared with the state-of-the-art algorithms.

Stack of Heatmap Hourglass Network for Face Alignment

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

An Occluded Stacked Hourglass Approach to Facial Landmark Localization and Occlusion Estimation

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Stacked Attention Hourglass Network Based Robust Facial Landmark Detection

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Stacked Hourglass Networks for Human Pose Estimation

Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment

Deformable Hourglass Network with Face Region Normalization for Robust Face Alignment

Improving Human Pose Estimation Based on Stacked Hourglass Network

Sub-pixel face landmarks using heatmaps and a bag of tricks

Atypical Facial Landmark Localisation with Stacked Hourglass Networks: A Study on 3D Facial Modelling for Medical Diagnosis

Learning Deformable Hourglass Networks (Dhgn) For Unconstrained Face Alignment

Large-Pose Face Alignment Via Shape-Aware Heatmap

Attention-Enhanced Lightweight Hourglass Network for Human Pose Estimation

Attention-Guided Coarse-to-Fine Network for 2D Face Alignment in the Wild

Human Pose Estimation of Diver Based on Improved Stacked Hourglass Model

Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking

An Improved Boundary-Aware Face Alignment Using Stacked Dense U-Nets

3-D Facial Landmarks Detection for Intelligent Video Systems