Abstract:Head pose estimation methods can be generally classified into two categories: model-based and appearance-based methods. The model-based approach relies on facial landmarks for three-dimensional reconstruction, aiming to achieve high-precision results. However, this method is heavily dependent on the accuracy of these landmarks. The appearance-based approach utilizes images as input and employs feature extraction and calculations to generate outcomes. While the appearance-based method boasts greater robustness, its accuracy falls short of the former. In this paper, a new and effective hybrid method is proposed. This hybrid approach combines the strengths of both methods. Unlike the conventional model-based methods, the proposed method regards the facial landmarks in 2D images as a sequence of neural network inputs and then obtains the head pose estimation results for users by neural network regression. The proposed method solves the fuzzy rotation labeling problem by using a rotation matrix representation, introducing a 6D rotation matrix representation as an intermediate state of the rotation matrix to achieve effective direct regression. Introducing face processing enhances the robustness of the model in cross-dataset scenarios. The proposed method achieves remarkable results based on imprecise face recognition and a simplistic model. The proposed method can be divided into three parts. First, the proposed method applies face processing on the input image; second, the method detects facial landmarks; and third, it converts these facial landmarks into sequences and obtains the 6D rotation representation of the head pose by regression. Extensive experiments on the publicly available BIWI, PRIMA, and DrivFace datasets show that this method is functional and performs better than other state-of-the-art methods. Compared to other methods, this approach demonstrates an average performance improvement of at least 10% across the dataset.

Face Pose Estimation Based on Elliptical Model and Neural Network

Human Pose Estimation Method Based On Flexible Model And Deep Learning

A Facial Pose Estimation Algorithm Using Deep Learning.

Human Pose Estimation Based on Step Deep Convolution Neural Network.

Face Pose Estimation Based on 3D Models and Affine Correspondences

Face Pose Estimation Method Based on 3D Model

Statistical model-based face pose estimation

3D Face Pose Estimation Based on Affine Transformation and Linear Regression

Overview of Human Pose Estimation Methods Based on Deep Learning

Multiclass Classification Based on a Deep Convolutional Network for Head Pose Estimation

6DFLRNet: 6D rotation representation for head pose estimation based on facial landmarks and regression

Improved Modular Convolution Neural Network for Human Pose Estimation

Relative Pose Estimation of Visual SLAM Based on Convolutional Neural Networks

Deep Energies for Estimating Three-Dimensional Facial Pose and Expression

3d Head Pose Estimation With Convolutional Neural Network Trained On Synthetic Images

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Accurate Head Pose Estimation Based on Multi-Stage Regression.

Face Pose Estimate Technology and Its Application in Video Invigilation

Pose Estimation Based On Gaussian Error Models

A 3D Human Body Modeling Method Based on Neural Network

Head Pose Estimation Based on Robust Convolutional Neural Network