Abstract:The problem of image-based head pose estimation attracts intensive attention due to a large number of applications such as face analysis and attention modeling. Existing methods often convert head pose estimation into the pose classification problem, but ignored the non-stationary appearance change brought about by the equally distributed bins. This paper targets the head pose estimation problem via deep neural decision trees, where the non-linear property of the representative appearance is learned together with the bin classification probability. First, we use Convolutional Neural Network (CNN) to get pose related features. Second, we apply the Fully Connected (FC) layer on the learned features to extract branch weight for each Euler angle and the representative values for each bin. Third, we employ neural decision tree on the branch weight to get bin classification probability. To explicitly characterize the relationship between the adjacent pose intervals, we embed continuity of the head angles into the tree architecture by constructing the bridge-tree. The final estimation is obtained via a weighted sum between the estimated bin probability and the representative bin values. We evaluate our methods on different public datasets including Pointing'04, Chinese Academy of Sciences-Pose, Expression, Accessory, and Lighting (CAS-PEAL) and Biwi Kinect Head Pose and find that, the proposed method outperforms as compared to state-of-the-art. Besides, we leverage the template marching based alignment for data preprocessing and demonstrate its superiority over traditional alignment methods on the task of head pose estimation.

Head Pose Estimation with Combined 2D SIFT and 3D HOG Features

3D head tracking using SIFT-based registration and scale invariant view-based appearance model

Face pose estimation with combined 2D and 3D HOG features

Three-dimensional head pose tracking using registration and multi-scale appearance model

Head pose estimation from low-resolution image with hough forest

Large head movement tracking using sift-based registration.

Accurate and Fast 3D Head Pose Estimation with Noisy RGBD Images

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Non-Stationary Representation for Continuity Aware Head Pose Estimation Via Deep Neural Decision Trees.

Estimating Head Pose Orientation Using Extremely Low Resolution Images

Human Head Pose Estimation Through Temporal Enhanced and Accurate Self-Supervised Depth Prediction

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

A Study of Two Image Representations for Head Pose Estimation

Head Pose Estimation on Top of Haar-Like Face Detection: A Study Using the Kinect Sensor

Real-Time Head Pose Estimation by RGB-D Camera.

Real-Time Head Pose Estimation Based on Kalman Filter and Random Regression Forest

Accurate Head Pose Estimation Based on Multi-Stage Regression.

Mixture Of Deep Regression Networks For Head Pose Estimation

Head Pose Estimation Based on a Second Order Histogram of the Orientation Gradient

Human Pose Estimation Combined With Depth Information