Abstract:Face alignment is a critical task in many multimedia and vision applications that use face-based algorithms. Recent research has focused on achieving efficient initialization to improve performance; however, the use of facial attributes and the extent of their correlation with initialization have not been fully exploited. This paper presents a lightweight method called expression- and pose-based adaptive initialization (EXPAI), in which facial attributes, that is, expression and pose information, are used as priors. This approach can significantly improve the face alignment performance. In addition, reliable expression and head pose information can be derived simultaneously in the same framework. First, an expression- and pose-based template dictionary is formed by augmenting the mean shape across three degrees of freedom, thereby substantially improving the robustness of the initial shape with respect to large head pose variations. Second, each the template corresponds to an image of interest, which is jointly determined using a shape-constrained multiclass classifier and binary classifiers, and is assigned a pretrained confidence coefficient. The initial shape that is thus generated for subsequent cascaded regression is more adaptive and enables higher accuracy. Furthermore, EXPAI enables initialization with significantly increased computational efficiency because of its independence from the original dataset. The experimental results obtained on the widely used 300-W dataset show that our method achieves very competitive performance compared with that of state-of-the-art methods. In particular, for the challenging subset of 300-W, EXPAI reduces errors by more than 14% compared with coarse-to-fine shape searching (CFSS), which currently exhibits the best performance among regression-based approaches. Furthermore, a speed increase of more than 10 times compared with CFSS is achieved.

Pose-Indexed Based Multi-View Method For Face Alignment

Multi‐scale Cross‐domain Alignment for Person Image Generation

Face alignment based on high order markov random field

Face Alignment Based on 3D Face Shape Model and Markov Random Field.

Cascade of Forests for Face Alignment

Multi-view face alignment using 3D shape model for view estimation

Multi-view face alignment guided by several facial feature points

Face Pose Normalization and Simulation Methods Based on Multi-View Face Alignment

Pose-Invariant 3D Face Alignment

Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment

Multi-view Human Pose and Shape Estimation Via Mesh-Aligned Voxel Interpolation

Face Alignment with Expression- and Pose-Based Adaptive Initialization

Pose-Robust Face Alignment with Adaptive Supervised Descent Method

M3 CSR: Multi-view, multi-scale and multi-component cascade shape regression

Fast multi-view face alignment via multi-task auto-encoders

Joint Face Detection and Initialization for Face Alignment.

Multi-View Based Pose Alignment Method For Person Re-Identification

A New Method For Face Alignment Under Extreme Poses And Occlusion

Joint Multi-View Face Alignment in the Wild

Salient-points-guided Face Alignment

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition