Abstract:In this paper, we introduce a novel method for detecting facial landmarks, termed the spatial fusion regression augmentation network (SFRA), which aims to improve the spatial generalization capabilities of coordinate based regression techniques. The SFRA consists of three components, namely, the landmark feature enhancement network (LFE), spatial relationship modeling network (SRM), and landmark coordinate regression (LCR) network. The LFE is capable of incorporating prior information into the extracted landmark features, thus boosting their representational capacity. The SRM is capable of understanding the local interaction and global interaction among the landmark patches before they are passed to the LCR to predict the coordinates of the landmarks. Then, the output from each predicted coordinates from the LCR feeds into the subsequent stage's LFE to improve feature representation, creating a pyramid-like multistage structure that refines details progressively from a coarse to a fine level, ultimately achieving precise facial landmark predictions. The proposed method was rigorously tested on the 300W, WFLW and COFW datasets, achieving normalized mean error (NME) metrics of 3.07%, 4.11% and 3.29% respectively, thus placing it to be the best performing coordinate based regression methods; its performance when compared with the best heatmap based regression methods, is mixed, in that on the WFLW dataset, it is better, on the 300W dataset it is slightly worse, and on the COFW dataset, it is better if the normalization factor in the NME metric is based on inter-ocular distances, while using inter-pupil distances, it is slightly worse than the best method in the heatmap based regression methods. Lastly, ablation studies are performed to confirm the efficacy of the proposed approach.

Spatial Gradient Guided Learning and Semantic Relation Transfer for Facial Landmark Detection.

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

A Robust Facial Landmark Detector with Mixed Loss

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Robust Facial Landmark Detection Via Heatmap-Offset Regression

Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking

RelationNet: Learning Deep-Aligned Representation for Semantic Image Segmentation

Learn Fine-Grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images

Utilize Spatial Prior in Ground Truth: Spatial-Enhanced Loss for Semantic Segmentation.

Hierarchical Facial Landmark Localization Via Cascaded Random Binary Patterns

STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detection

SFRA: spatial fusion regression augmentation network for facial landmark detection

Joint Stacked Hourglass Network and Salient Region Attention Refinement for Robust Face Alignment

Spine Landmark Localization with combining of Heatmap Regression and Direct Coordinate Regression

Sub-pixel face landmarks using heatmaps and a bag of tricks

Robust and efficient facial landmark localization

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

106-Point Facial Landmark Localization with Mobile Networks Based on Regression.

The Equalization Losses: Gradient-Driven Training for Long-tailed Object Recognition

Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.