Abstract:Mainstream methods treat head pose estimation as a supervised classification/regression problem, whose performance heavily depends on the accuracy of ground-truth labels of training data. However, it is rather difficult to obtain accurate head pose labels in practice, due to the lack of effective equipment and reasonable approaches for head pose labeling. In this paper, we propose a method which does not need to be trained with head pose labels, but matches the keypoints between a reconstructed 3D face model and the 2D input image, for head pose estimation. The proposed head pose estimation method consists of two components: the 3D face reconstruction and the 3D–2D matching keypoints. At the 3D face reconstruction phase, a personalized 3D face model is reconstructed from the input head image using convolutional neural networks, which are jointly optimized by an asymmetric Euclidean loss and a keypoint loss. At the 3D–2D keypoints matching phase, an iterative optimization algorithm is proposed to match the keypoints between the reconstructed 3D face model and the 2D input image efficiently under the constraint of perspective transformation. The proposed method is extensively evaluated on five widely used head pose estimation datasets, including Pointing’04, BIWI, AFLW2000, Multi-PIE, and Pandora. The experimental results demonstrate that the proposed method achieves excellent cross-dataset performance and surpasses most of the existing state-of-the-art approaches, with average MAEs of 4.78∘ on Pointing’04, 6.83∘ on BIWI, 7.05∘ on AFLW2000, 5.47∘ on Multi-PIE, and 5.06∘ on Pandora, although the model of the proposed method is not trained on any of these five datasets.

Transfer Useful Knowledge for Headpose Estimation from Low Resolution Images

Robust Human Tracking Via Key Face Information.

Head Tracking by Means of Probabilistic Neural Networks

Low-resolution human pose estimation

Head Pose Estimation through Keypoints Matching between Reconstructed 3D Face Model and 2D Image

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Head pose estimation from low-resolution image with hough forest

Self-Attention Mechanism-Based Head Pose Estimation Network with Fusion of Point Cloud and Image Features

Human Head Pose Estimation Through Temporal Enhanced and Accurate Self-Supervised Depth Prediction

FSKT‐GE: Feature maps similarity knowledge transfer for low‐resolution gaze estimation

A survey of head pose estimation methods

2DHeadPose: A simple and effective annotation method for the head pose in RGB images and its dataset

Deep High-Resolution Representation Learning For Human Pose Estimation

Affine Correspondence Based Head Pose Estimation For A Sequence Of Images By Using A 3d Model

Semi-Supervised Unconstrained Head Pose Estimation in the Wild

Joint Head Pose and Facial Landmark Regression from Depth Images

An Effective Deep Network for Head Pose Estimation without Keypoints

Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions

Person-independent head pose estimation based on random forest regression