Abstract:Regression-based face alignment involves learning a series of mapping functions to predict the true landmarks from an initial estimation of the alignment. Most existing approaches focus on learning efficacious mapping functions from some feature representations to improve performance. The issues related to the initial alignment estimation and the final learning objective, however, receive less attention. This work proposes a deep regression architecture with progressive reinitialization and a new error-driven learning loss function to explicitly address the above two issues. Given an image with a rough face detection result, the full face region is first mapped by a supervised spatial transformer network to a normalized form and trained to regress coarse positions of landmarks. Then, different face parts are further respectively reinitialized to their own normalized states, followed by another regression sub-network to refine the landmark positions. To deal with the inconsistent annotations in existing training datasets, we further propose an adaptive landmark-weighted loss function. It dynamically adjusts the importance of different landmarks according to their learning errors during training without depending on any hyper-parameters manually set by trial and error. A high level of robustness to annotation inconsistencies is thus achieved. The whole deep architecture permits training from end to end, and extensive experimental analyses and comparisons demonstrate its effectiveness and efficiency. The source code, trained models, and experimental results are made available at https://github.com/shaoxiaohu/Face_Alignment_DPR.git.

Joint Face Detection and Alignment with a Deformable Hough Transform Model

Cascade of Forests for Face Alignment

Learning spatial-temporal deformable networks for unconstrained face alignment and tracking in videos

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Face alignment based on high order markov random field

Joint Multi-View Face Alignment in the Wild

Unsupervised Face Alignment by Robust Nonrigid Mapping

Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks

Dynamic Deformable Transformer for End‐to‐end Face Alignment

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Learning Deep Sharable and Structural Detectors for Face Alignment

Joint 3d Face Reconstruction And Dense Face Alignment Via Deep Face Feature Alignment

Multistage Model for Robust Face Alignment Using Deep Neural Networks

Joint Face Detection and Facial Motion Retargeting for Multiple Faces

Robust Face Alignment by Multi-Order High-Precision Hourglass Network

Disjoint Pose and Shape for 3D Face Reconstruction

Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

A Method for Non-Rigid Face Alignment Via Combining Local and Holistic Matching.

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Feedback Cascade Regression Model for Face Alignment

Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network