Abstract:Mainstream methods treat head pose estimation as a supervised classification/regression problem, whose performance heavily depends on the accuracy of ground-truth labels of training data. However, it is rather difficult to obtain accurate head pose labels in practice, due to the lack of effective equipment and reasonable approaches for head pose labeling. In this paper, we propose a method which does not need to be trained with head pose labels, but matches the keypoints between a reconstructed 3D face model and the 2D input image, for head pose estimation. The proposed head pose estimation method consists of two components: the 3D face reconstruction and the 3D–2D matching keypoints. At the 3D face reconstruction phase, a personalized 3D face model is reconstructed from the input head image using convolutional neural networks, which are jointly optimized by an asymmetric Euclidean loss and a keypoint loss. At the 3D–2D keypoints matching phase, an iterative optimization algorithm is proposed to match the keypoints between the reconstructed 3D face model and the 2D input image efficiently under the constraint of perspective transformation. The proposed method is extensively evaluated on five widely used head pose estimation datasets, including Pointing’04, BIWI, AFLW2000, Multi-PIE, and Pandora. The experimental results demonstrate that the proposed method achieves excellent cross-dataset performance and surpasses most of the existing state-of-the-art approaches, with average MAEs of 4.78∘ on Pointing’04, 6.83∘ on BIWI, 7.05∘ on AFLW2000, 5.47∘ on Multi-PIE, and 5.06∘ on Pandora, although the model of the proposed method is not trained on any of these five datasets.

Image set-based face recognition using pose estimation with facial landmarks

Face recognition with contiguous occlusion using linear regression and level set method

Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation

Face Sketch Landmarks Localization in the Wild

End-to-End Spatial Transform Face Detection and Recognition

Pose-invariant Face Recognition via SIFT Vocabulary Tree

Multi-task pose-invariant face recognition.

Part-Based Set Matching For Face Recognition In Surveillance

Pose-Invariant 3D Face Alignment

Face identification using reference-based features with message passing model

LS-SIFT: Enhancing the Robustness of SIFT During Pose-Invariant Face Recognition by Learning Facial Landmark Specific Mappings

Manifold-Manifold Distance with application to face recognition based on image set

Open-set Face Recognition for Small Galleries Using Siamese Networks

Cross-pose face recognition based on partial least squares

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Head Pose Estimation through Keypoints Matching between Reconstructed 3D Face Model and 2D Image

Pose-robust Feature Learning for Pose-Invariant Face Recognition

Locally Linear Regression for Pose-Invariant Face Recognition

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Image-to-Set Face Recognition Using Locality Repulsion Projections and Sparse Reconstruction-Based Similarity Measure