Abstract:Face alignment is a critical task in many multimedia and vision applications that use face-based algorithms. Recent research has focused on achieving efficient initialization to improve performance; however, the use of facial attributes and the extent of their correlation with initialization have not been fully exploited. This paper presents a lightweight method called expression- and pose-based adaptive initialization (EXPAI), in which facial attributes, that is, expression and pose information, are used as priors. This approach can significantly improve the face alignment performance. In addition, reliable expression and head pose information can be derived simultaneously in the same framework. First, an expression- and pose-based template dictionary is formed by augmenting the mean shape across three degrees of freedom, thereby substantially improving the robustness of the initial shape with respect to large head pose variations. Second, each the template corresponds to an image of interest, which is jointly determined using a shape-constrained multiclass classifier and binary classifiers, and is assigned a pretrained confidence coefficient. The initial shape that is thus generated for subsequent cascaded regression is more adaptive and enables higher accuracy. Furthermore, EXPAI enables initialization with significantly increased computational efficiency because of its independence from the original dataset. The experimental results obtained on the widely used 300-W dataset show that our method achieves very competitive performance compared with that of state-of-the-art methods. In particular, for the challenging subset of 300-W, EXPAI reduces errors by more than 14% compared with coarse-to-fine shape searching (CFSS), which currently exhibits the best performance among regression-based approaches. Furthermore, a speed increase of more than 10 times compared with CFSS is achieved.

Better Initialization for Regression-Based Face Alignment.

Cascade of Forests for Face Alignment

Robust Face Alignment via Deep Progressive Reinitialization and Adaptive Error-driven Learning

Salient-points-guided Face Alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

A Deep Regression Architecture with Two-Stage Re-initialization for High Performance Facial Landmark Detection.

Face alignment based on high order markov random field

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Feedback Cascade Regression Model for Face Alignment

Face Alignment with Expression- and Pose-Based Adaptive Initialization

High-Quality Initial Shape Estimation for Cascade Shape Regression

Face Alignment with Two-Layer Shape Regression

Robust Facial Landmark Detection Based On Initializing Multiple Poses

Lasso Based Shape Regression for Face Alignment

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

An Improved Active Shape Model for Face Alignment

Adaptive Cascade Regression Model for Robust Face Alignment.

Toward End-to-End Face Recognition Through Alignment Learning

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

Efficient Face Alignment with Fast Normalization and Contour Fitting Loss