Abstract:Regression-based face alignment involves learning a series of mapping functions to predict the true landmarks from an initial estimation of the alignment. Most existing approaches focus on learning efficacious mapping functions from some feature representations to improve performance. The issues related to the initial alignment estimation and the final learning objective, however, receive less attention. This work proposes a deep regression architecture with progressive reinitialization and a new error-driven learning loss function to explicitly address the above two issues. Given an image with a rough face detection result, the full face region is first mapped by a supervised spatial transformer network to a normalized form and trained to regress coarse positions of landmarks. Then, different face parts are further respectively reinitialized to their own normalized states, followed by another regression sub-network to refine the landmark positions. To deal with the inconsistent annotations in existing training datasets, we further propose an adaptive landmark-weighted loss function. It dynamically adjusts the importance of different landmarks according to their learning errors during training without depending on any hyper-parameters manually set by trial and error. A high level of robustness to annotation inconsistencies is thus achieved. The whole deep architecture permits training from end to end, and extensive experimental analyses and comparisons demonstrate its effectiveness and efficiency. The source code, trained models, and experimental results are made available at https://github.com/shaoxiaohu/Face_Alignment_DPR.git.

A Fast and Robust Automatic Face Alignment System

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

A Method for Accurate Localization of Facial Features

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Robust Face Recognition by Constrained Part-based Alignment.

Robust Face Recognition Via Accurate Face Alignment and Sparse Representation

Unsupervised Face Alignment by Robust Nonrigid Mapping

A Two-Stage Approach To Automatic-Face Alignment

An Automatic Human Face Recognition System

Face alignment under various poses and expressions

Complete Automatic Target Recognition System for Real-Time Human Face Images

Robust Face Alignment Based on Hierarchical Classifier Network

Face Alignment In-the-Wild: A Survey

Robust Face Alignment Based on Local Texture Classifiers

Real-Time facial expression recognition system based on HMM and feature point localization

A System for Human Face and Facial Feature Location.

Example-Based Learning for Automatic Face Alignment

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Face Alignment Across Large Poses: A 3D Solution

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition