Abstract:Computer vision based on neural networks is an important part of modern cognitive research. As important applications, head detection and pose estimation have made breakthrough progress in recent years. Compared to RGB sensors, depth cameras can provide a reliable solution in unstable or poor lighting conditions. An efficient pose estimation method relies on accurate head centre localization. Based only on depth images, a new convolutional neural network named HDPNet, which implemented complete head detection and pose estimation in complex environments, was proposed. For the head detection part, HDPNet adopted a convolutional neural classification network and the mean shift algorithm to achieve high-precision head centre localization, and for the pose estimation part, a novel guidance network with L2 -norm was introduced to constrain the regression process of pose features. Moreover, soft label was adopted to encode the probability distribution between the pose ranges. To verify the performance of HDPNet, a series of experiments were conducted on four challenging public datasets: Watch-n-patch, the Biwi Head Pose dataset, Pandora and ICT-3DHP. Based on our experimental results with a comparison to state-of-the-art methods, the IoU of the head localization was improved by 2.2%, and the mean error in pose estimation was reduced by 0.1. The performance of our HDPNet outperformed the latest methods and could be effectively applied in a real environment.

From Depth Data to Head Pose Estimation: a Siamese approach

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

POSEidon: Face-from-Depth for Driver Pose Estimation

Siamese PointNet: 3D Head Pose Estimation with Local Feature Descriptor

Face-from-Depth for Head Pose Estimation on Depth Images

Siamese Regression Networks with Efficient mid-level Feature Extraction for 3D Object Pose Estimation

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Human Head Pose Estimation Through Temporal Enhanced and Accurate Self-Supervised Depth Prediction

Pose Estimation for Swimmers in Video Surveillance

An Effective Deep Network for Head Pose Estimation without Keypoints

3D Human Pose Estimation with Siamese Equivariant Embedding

Mixture Of Deep Regression Networks For Head Pose Estimation

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Human Pose Estimation Based on Step Deep Convolution Neural Network.

Real-time Convolutional Networks for Depth-based Human Pose Estimation

NETWORKS EFFECTIVELY UTILIZING 2D SPATIAL INFORMATION FOR ACCURATE 3D HAND POSE ESTIMATION

A Siamese Network for Face Verification with Depth Images

Multiclass Classification Based on a Deep Convolutional Network for Head Pose Estimation

Head Pose Estimation on Top of Haar-Like Face Detection: A Study Using the Kinect Sensor

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Scale Invariant Constrained Deep Network for Head Pose Estimation