Abstract:Head pose estimation methods can be generally classified into two categories: model-based and appearance-based methods. The model-based approach relies on facial landmarks for three-dimensional reconstruction, aiming to achieve high-precision results. However, this method is heavily dependent on the accuracy of these landmarks. The appearance-based approach utilizes images as input and employs feature extraction and calculations to generate outcomes. While the appearance-based method boasts greater robustness, its accuracy falls short of the former. In this paper, a new and effective hybrid method is proposed. This hybrid approach combines the strengths of both methods. Unlike the conventional model-based methods, the proposed method regards the facial landmarks in 2D images as a sequence of neural network inputs and then obtains the head pose estimation results for users by neural network regression. The proposed method solves the fuzzy rotation labeling problem by using a rotation matrix representation, introducing a 6D rotation matrix representation as an intermediate state of the rotation matrix to achieve effective direct regression. Introducing face processing enhances the robustness of the model in cross-dataset scenarios. The proposed method achieves remarkable results based on imprecise face recognition and a simplistic model. The proposed method can be divided into three parts. First, the proposed method applies face processing on the input image; second, the method detects facial landmarks; and third, it converts these facial landmarks into sequences and obtains the 6D rotation representation of the head pose by regression. Extensive experiments on the publicly available BIWI, PRIMA, and DrivFace datasets show that this method is functional and performs better than other state-of-the-art methods. Compared to other methods, this approach demonstrates an average performance improvement of at least 10% across the dataset.

FDN: Feature Decoupling Network for Head Pose Estimation.

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Direction-Sensitivity Features Ensemble Network for Rotation-Invariant Face Detection.

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

Implicit Decouple Network for Efficient Pose Estimation

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos

Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition.

Multiview Facial Landmark Localization in RGB-D Images Via Hierarchical Regression with Binary Patterns.

Attention-Based RGBD Fusenet for Monocular 3D Body Geometry and Pose Reconstruction.

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

LHFF-Net: Local heterogeneous feature fusion network for 6DoF pose estimation

A Lightweight Color and Geometry Feature Extraction and Fusion Module for End-to-end 6D Pose Estimation

DenseFusion-DA2: End-to-End Pose-Estimation Network Based on RGB-D Sensors and Multi-Channel Attention Mechanisms

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

FacePoseNet: Making a Case for Landmark-Free Face Alignment

DHFNet: Decoupled Hierarchical Fusion Network for RGB-T dense prediction tasks

A Complementary Dual-branch Network for Appearance-based Gaze Estimation from Low-resolution Facial Image

6DFLRNet: 6D rotation representation for head pose estimation based on facial landmarks and regression

A modal fusion network with dual attention mechanism for 6D pose estimation