Abstract:Regression-based face alignment involves learning a series of mapping functions to predict the true landmarks from an initial estimation of the alignment. Most existing approaches focus on learning efficacious mapping functions from some feature representations to improve performance. The issues related to the initial alignment estimation and the final learning objective, however, receive less attention. This work proposes a deep regression architecture with progressive reinitialization and a new error-driven learning loss function to explicitly address the above two issues. Given an image with a rough face detection result, the full face region is first mapped by a supervised spatial transformer network to a normalized form and trained to regress coarse positions of landmarks. Then, different face parts are further respectively reinitialized to their own normalized states, followed by another regression sub-network to refine the landmark positions. To deal with the inconsistent annotations in existing training datasets, we further propose an adaptive landmark-weighted loss function. It dynamically adjusts the importance of different landmarks according to their learning errors during training without depending on any hyper-parameters manually set by trial and error. A high level of robustness to annotation inconsistencies is thus achieved. The whole deep architecture permits training from end to end, and extensive experimental analyses and comparisons demonstrate its effectiveness and efficiency. The source code, trained models, and experimental results are made available at https://github.com/shaoxiaohu/Face_Alignment_DPR.git.

Heterogenous output regression network for direct face alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Cascade of Forests for Face Alignment

Direct Shape Regression Networks For End-To-End Face Alignment

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Robust Face Alignment Based on Hierarchical Classifier Network

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Attentional Alignment Networks.

Learning Deformable Hourglass Networks (Dhgn) For Unconstrained Face Alignment

Robust 3D Face Alignment with Multi-Path Neural Architecture Search

Deep Multi-Center Learning for Face Alignment

Real-time Memory Efficient Large-pose Face Alignment via Deep Evolutionary Network

Learning Relational-Structural Networks For Robust Face Alignment

PropagationNet: Propagate Points to Curve to Learn Structure Information

Face Alignment by Deep Convolutional Network with Adaptive Learning Rate.

Face Alignment with Cascaded Bidirectional LSTM Neural Networks.

Learning Facial Point Response For Alignment By Purely Convolutional Network

Multistage Model for Robust Face Alignment Using Deep Neural Networks

AdaptiveNet - Toward an Efficient Face Alignment Algorithm.

Attention-Guided Coarse-to-Fine Network for 2D Face Alignment in the Wild