Abstract:Regression-based face alignment involves learning a series of mapping functions to predict the true landmarks from an initial estimation of the alignment. Most existing approaches focus on learning efficacious mapping functions from some feature representations to improve performance. The issues related to the initial alignment estimation and the final learning objective, however, receive less attention. This work proposes a deep regression architecture with progressive reinitialization and a new error-driven learning loss function to explicitly address the above two issues. Given an image with a rough face detection result, the full face region is first mapped by a supervised spatial transformer network to a normalized form and trained to regress coarse positions of landmarks. Then, different face parts are further respectively reinitialized to their own normalized states, followed by another regression sub-network to refine the landmark positions. To deal with the inconsistent annotations in existing training datasets, we further propose an adaptive landmark-weighted loss function. It dynamically adjusts the importance of different landmarks according to their learning errors during training without depending on any hyper-parameters manually set by trial and error. A high level of robustness to annotation inconsistencies is thus achieved. The whole deep architecture permits training from end to end, and extensive experimental analyses and comparisons demonstrate its effectiveness and efficiency. The source code, trained models, and experimental results are made available at https://github.com/shaoxiaohu/Face_Alignment_DPR.git.

Unconstrained Face Alignment Without Face Detection.

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

End-to-End Spatial Transform Face Detection and Recognition

Face Sketch Landmarks Localization in the Wild

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

FreeEnricher: Enriching Face Landmarks Without Additional Cost

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Robust 3D face landmark localization based on local coordinate coding.

FacePoseNet: Making a Case for Landmark-Free Face Alignment

Joint Multi-View Face Alignment in the Wild

Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition.

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Face Alignment Based on Two-Stage Localization

3-D Facial Landmarks Detection for Intelligent Video Systems

Dual Sparse Constrained Cascade Regression for Robust Face Alignment.

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Learning Deep Sharable and Structural Detectors for Face Alignment

Effective face landmark localization via single deep network