Abstract:Face alignment is an essential task for facial performance capture and expression analysis. As a complex nonlinear problem in computer vision, face alignment across poses is still not studied well. Although the state-of-the-art Supervised Descent Method (SDM) has shown good performance, it learns conflict descent direction in the whole complex space due to various poses and expressions. Global SDM has been presented to deal with this case by domain partition in feature and shape PCA spaces for face tracking and pose estimation. However, it is not suitable for the face alignment problem due to unknown ground truth shapes. In this paper we propose a sign-correlation subspace method for the domain partition of global SDM. In our method only one reduced low dimensional subspace is enough for domain partition, thus adjusting the global SDM efficiently for face alignment. Unlike previous methods, we analyze the sign correlation between features and shapes, and project both of them into a mutual sign-correlation subspace. Each pair of projected shape and feature keep sign consistent in each dimension of the subspace, so that each hyperoctant holds the condition that one general descent exists. Then a set of general descent directions are learned from the samples in different hyperoctants. Our sign-correlation partition method is validated in the public face datasets, which includes a range of poses. It indicates that our methods can reveal their latent relationships to poses. The comparison with state-of-the-art methods for face alignment demonstrates that our method outperforms them especially in uncontrolled conditions with various poses, while keeping comparable speed.

Sign-correlation Cascaded Regression for Face Alignment.

Sign-Correlation Partition Based On Global Supervised Descent Method For Face Alignment

Sign Correlation Subspace for Face Alignment

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Cascade of Forests for Face Alignment

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Face Alignment via Multi-Regressors Collaborative Optimization.

Robust 3D Face Recognition by Local Shape Difference Boosting

Pose-Robust Face Alignment with Adaptive Supervised Descent Method

Dual Sparse Constrained Cascade Regression for Robust Face Alignment.

Extended Supervised Descent Method for Robust Face Alignment

Coarse-to-Fine Supervised Descent Method for Face Alignment

Extended Robust Cascaded Pose Regression for Face Alignment

Salient-points-guided Face Alignment

Robust Face Recognition by Constrained Part-based Alignment.

Deep Shape Constrained Network for Robust Face Alignment.

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Adaptive Cascade Regression Model for Robust Face Alignment.

Efficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement.

Feedback Cascade Regression Model for Face Alignment

Joint Local Regressors Learning for Face Alignment.