Abstract:Head pose estimation methods can be generally classified into two categories: model-based and appearance-based methods. The model-based approach relies on facial landmarks for three-dimensional reconstruction, aiming to achieve high-precision results. However, this method is heavily dependent on the accuracy of these landmarks. The appearance-based approach utilizes images as input and employs feature extraction and calculations to generate outcomes. While the appearance-based method boasts greater robustness, its accuracy falls short of the former. In this paper, a new and effective hybrid method is proposed. This hybrid approach combines the strengths of both methods. Unlike the conventional model-based methods, the proposed method regards the facial landmarks in 2D images as a sequence of neural network inputs and then obtains the head pose estimation results for users by neural network regression. The proposed method solves the fuzzy rotation labeling problem by using a rotation matrix representation, introducing a 6D rotation matrix representation as an intermediate state of the rotation matrix to achieve effective direct regression. Introducing face processing enhances the robustness of the model in cross-dataset scenarios. The proposed method achieves remarkable results based on imprecise face recognition and a simplistic model. The proposed method can be divided into three parts. First, the proposed method applies face processing on the input image; second, the method detects facial landmarks; and third, it converts these facial landmarks into sequences and obtains the 6D rotation representation of the head pose by regression. Extensive experiments on the publicly available BIWI, PRIMA, and DrivFace datasets show that this method is functional and performs better than other state-of-the-art methods. Compared to other methods, this approach demonstrates an average performance improvement of at least 10% across the dataset.

SRNet: Structural Relation-aware Network for Head Pose Estimation

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

FDN: Feature Decoupling Network for Head Pose Estimation.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Pose Estimation for Swimmers in Video Surveillance

RSGNet: Relation Based Skeleton Graph Network for Crowded Scenes Pose Estimation

A-HRNet: Attention Based High Resolution Network for Human Pose Estimation

SRPose: Two-view Relative Pose Estimation with Sparse Keypoints

Siamese PointNet: 3D Head Pose Estimation with Local Feature Descriptor

HeadNet: an End-to-End Adaptive Relational Network for Head Detection

Lightweight Super-Resolution Head for Human Pose Estimation

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Self-Attention Mechanism-Based Head Pose Estimation Network with Fusion of Point Cloud and Image Features

DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation

I^2R-Net: Intra- and Inter-Human Relation Network for Multi-Person Pose Estimation

6DFLRNet: 6D rotation representation for head pose estimation based on facial landmarks and regression

Free-Head Pose Estimation under Low-Resolution Scenarios

Pseudo View Representation Learning for Monocular RGB-D Human Pose and Shape Estimation

DSC-HRNet: a lightweight teaching pose estimation model with depthwise separable convolution and deep high-resolution representation learning in computer-aided education

Joint Human Detection and Head Pose Estimation Via Multistream Networks for RGB-D Videos