Abstract:In this paper, we introduce a novel method for detecting facial landmarks, termed the spatial fusion regression augmentation network (SFRA), which aims to improve the spatial generalization capabilities of coordinate based regression techniques. The SFRA consists of three components, namely, the landmark feature enhancement network (LFE), spatial relationship modeling network (SRM), and landmark coordinate regression (LCR) network. The LFE is capable of incorporating prior information into the extracted landmark features, thus boosting their representational capacity. The SRM is capable of understanding the local interaction and global interaction among the landmark patches before they are passed to the LCR to predict the coordinates of the landmarks. Then, the output from each predicted coordinates from the LCR feeds into the subsequent stage's LFE to improve feature representation, creating a pyramid-like multistage structure that refines details progressively from a coarse to a fine level, ultimately achieving precise facial landmark predictions. The proposed method was rigorously tested on the 300W, WFLW and COFW datasets, achieving normalized mean error (NME) metrics of 3.07%, 4.11% and 3.29% respectively, thus placing it to be the best performing coordinate based regression methods; its performance when compared with the best heatmap based regression methods, is mixed, in that on the WFLW dataset, it is better, on the 300W dataset it is slightly worse, and on the COFW dataset, it is better if the normalization factor in the NME metric is based on inter-ocular distances, while using inter-pupil distances, it is slightly worse than the best method in the heatmap based regression methods. Lastly, ablation studies are performed to confirm the efficacy of the proposed approach.

Feature Fusion Based Constrained Local Model for Three-Dimensional Facial Landmark Localization

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

3D facial landmark localization via a local surface descriptor HoSNI

Face Sketch Landmarks Localization in the Wild

Real-time Localization of 3D Facial Landmarks

Robust 3D face landmark localization based on local coordinate coding.

Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition.

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

Automatic landmark annotation and dense correspondence registration for 3D human facial images

3-D Facial Landmarks Detection for Intelligent Video Systems

SFRA: spatial fusion regression augmentation network for facial landmark detection

68 landmarks are efficient for 3D face alignment: what about more?

An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning

Facial Landmark Detection: a Literature Survey

Feature Fusion for Facial Landmark Point Location

Robust 3D Face Recognition by Local Shape Difference Boosting