Abstract:Head pose estimation methods can be generally classified into two categories: model-based and appearance-based methods. The model-based approach relies on facial landmarks for three-dimensional reconstruction, aiming to achieve high-precision results. However, this method is heavily dependent on the accuracy of these landmarks. The appearance-based approach utilizes images as input and employs feature extraction and calculations to generate outcomes. While the appearance-based method boasts greater robustness, its accuracy falls short of the former. In this paper, a new and effective hybrid method is proposed. This hybrid approach combines the strengths of both methods. Unlike the conventional model-based methods, the proposed method regards the facial landmarks in 2D images as a sequence of neural network inputs and then obtains the head pose estimation results for users by neural network regression. The proposed method solves the fuzzy rotation labeling problem by using a rotation matrix representation, introducing a 6D rotation matrix representation as an intermediate state of the rotation matrix to achieve effective direct regression. Introducing face processing enhances the robustness of the model in cross-dataset scenarios. The proposed method achieves remarkable results based on imprecise face recognition and a simplistic model. The proposed method can be divided into three parts. First, the proposed method applies face processing on the input image; second, the method detects facial landmarks; and third, it converts these facial landmarks into sequences and obtains the 6D rotation representation of the head pose by regression. Extensive experiments on the publicly available BIWI, PRIMA, and DrivFace datasets show that this method is functional and performs better than other state-of-the-art methods. Compared to other methods, this approach demonstrates an average performance improvement of at least 10% across the dataset.

Mixture Of Deep Regression Networks For Head Pose Estimation

FDN: Feature Decoupling Network for Head Pose Estimation.

Mixture of Related Regressions for Head Pose Estimation

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions

Accurate Head Pose Estimation Based on Multi-Stage Regression.

Self-Attention Mechanism-Based Head Pose Estimation Network with Fusion of Point Cloud and Image Features

Human Head Pose Estimation Through Temporal Enhanced and Accurate Self-Supervised Depth Prediction

Multiclass Classification Based on a Deep Convolutional Network for Head Pose Estimation

Joint Human Detection and Head Pose Estimation Via Multistream Networks for RGB-D Videos

6DFLRNet: 6D rotation representation for head pose estimation based on facial landmarks and regression

Deep convolutional neural network-based Bernoulli heatmap for head pose estimation

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Person-independent head pose estimation based on random forest regression

3d Head Pose Estimation With Convolutional Neural Network Trained On Synthetic Images

Mixture Dense Regression for Object Detection and Human Pose Estimation

Attention-Guided Huber Loss for Head Pose Estimation Based on Improved Capsule Network

From Depth Data to Head Pose Estimation: a Siamese approach

Deep Regression Forest with Soft-Attention for Head Pose Estimation

Non-Stationary Representation for Continuity Aware Head Pose Estimation Via Deep Neural Decision Trees.

Head Pose Estimation Based on Robust Convolutional Neural Network