Abstract:Facial landmark detection aims at localizing multiple keypoints for a given facial image, which usually suffers from variations caused by arbitrary pose, diverse facial expression and partial occlusion. In this paper, we develop a two-stage regression network for facial landmark detection on unconstrained conditions. Our model consists of a Structural Hourglass Network (SHN) for detecting the initial locations of all facial landmarks based on heatmap generation, and a Global Constraint Network (GCN) for further refining the detected locations based on offset estimation. Specifically, SHN introduces an improved Inception-ResNet unit as basic building block, which can effectively improve the receptive field and learn contextual feature representations. In the meanwhile, a novel loss function with adaptive weight is proposed to make the whole model focus on the hard landmarks precisely. GCN attempts to explore the spatial contextual relationship between facial landmarks and refine the initial locations of facial landmarks by optimizing the global constraint. Moreover, we develop a pre-processing network to generate features with different scales, which will be transmitted to SHN and GCN for effective feature representations. Different from existing models, the proposed method realizes the heatmap-offset framework, which combines the outputs of heatmaps generated by SHN and coordinates estimated by GCN, to obtain an accurate prediction. The extensive experimental results on several challenging datasets, including 300W, COFW, AFLW, and 300-VW confirm that our method achieve competitive performance compared with the state-of-the-art algorithms.

Towards Highly Accurate and Stable Face Alignment for High-Resolution Videos.

A Backbone Replaceable Fine-tuning Network for Stable Face Alignment

HIH: Towards More Accurate Face Alignment via Heatmap in Heatmap

Accurate Face Alignment and Adaptive Patch Selection for Heart Rate Estimation from Videos under Realistic Scenarios.

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

Adaptive Weighted Face Alignment by Multi-Scale Feature and Offset Prediction

Towards Fast, Accurate and Stable 3D Dense Face Alignment

Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking

Small and accurate heatmap-based face alignment via distillation strategy and cascaded architecture

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

SR-VFA: Accurate Self-Refined Face Alignment in Videos.

Dynamic Deformable Transformer for End‐to‐end Face Alignment

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Real-time high-fidelity facial performance capture

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment

Real-Time Face Alignment With Tracking In Video

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Quality-aware Face Alignment Using High-Resolution Spatial Dependencies

Fast Head Pose Estimation Via Rotation-Adaptive Facial Landmark Detection for Video Edge Computation.

Low-Resolution Face Recognition Enhanced by High-Resolution Facial Images

Improved Cnn-Based Facial Landmarks Tracking Via Ridge Regression at 150 Fps on Mobile Devices