Abstract:Head pose estimation serves various applications, such as gaze estimation, fatigue-driven detection, and virtual reality. Nonetheless, achieving precise and efficient predictions remains challenging owing to the reliance on singular data sources. Therefore, this study introduces a technique involving multimodal feature fusion to elevate head pose estimation accuracy. The proposed method amalgamates data derived from diverse sources, including RGB and depth images, to construct a comprehensive three-dimensional representation of the head, commonly referred to as a point cloud. The noteworthy innovations of this method encompass a residual multilayer perceptron structure within PointNet, designed to tackle gradient-related challenges, along with spatial self-attention mechanisms aimed at noise reduction. The enhanced PointNet and ResNet networks are utilized to extract features from both point clouds and images. These extracted features undergo fusion. Furthermore, the incorporation of a scoring module strengthens robustness, particularly in scenarios involving facial occlusion. This is achieved by preserving features from the highest-scoring point cloud. Additionally, a prediction module is employed, combining classification and regression methodologies to accurately estimate head poses. The proposed method improves the accuracy and robustness of head pose estimation, especially in cases involving facial obstructions. These advancements are substantiated by experiments conducted using the BIWI dataset, demonstrating the superiority of this method over existing techniques.

Phow Based Feature Detection for Head Pose Estimation

An Image Retrieval Method Synthesizing PHOG Shape Description and Wavelet Pyramid Energy Distribution

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Face Detection Method Based on Histogram of Sparse Code in Tree Deformable Model.

3D Feature Extraction of Head Based on Target Region Matching

Dynamic Feature Pyramid Networks for Detection

Pose-invariant Face Recognition via SIFT Vocabulary Tree

Head pose estimation from low-resolution image with hough forest

Head Pose Estimation on Top of Haar-Like Face Detection: A Study Using the Kinect Sensor

Static Head Pose Estimation under Different Illumination

Natural Scene Category Recognition Based on Multiple Channels of PHOW

Pose Estimation Via Complex-Frequency Domain Analysis of Image Gradient Orientations.

Head Detection Based on Convolutional Neural Network with Multi-Stage Weighted Feature

Self-Attention Mechanism-Based Head Pose Estimation Network with Fusion of Point Cloud and Image Features

Image classification based on pyramid histogram of topics

An Intuitive and Unconstrained 2D Cube Representation for Simultaneous Head Detection and Pose Estimation

Pyramid Knowledge Distillation for Efficient Human Pose Estimation.

Fine-Grained Dynamic Head for Object Detection.

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model

Head Pose Based Intention Prediction Using Discrete Dynamic Bayesian Network

Transfer Useful Knowledge for Headpose Estimation from Low Resolution Images