Abstract:Existing head pose estimation (HPE) mainly focuses on single person with pre-detected frontal heads, which limits their applications in real complex scenarios with multi-persons. We argue that these single HPE methods are fragile and inefficient for Multi-Person Head Pose Estimation (MPHPE) since they rely on the separately trained face detector that cannot generalize well to full viewpoints, especially for heads with invisible face areas. In this paper, we focus on the full-range MPHPE problem, and propose a direct end-to-end simple baseline named DirectMHP. Due to the lack of datasets applicable to the full-range MPHPE, we firstly construct two benchmarks by extracting ground-truth labels for head detection and head orientation from public datasets AGORA and CMU Panoptic. They are rather challenging for having many truncated, occluded, tiny and unevenly illuminated human heads. Then, we design a novel end-to-end trainable one-stage network architecture by joint regressing locations and orientations of multi-head to address the MPHPE problem. Specifically, we regard pose as an auxiliary attribute of the head, and append it after the traditional object prediction. Arbitrary pose representation such as Euler angles is acceptable by this flexible design. Then, we jointly optimize these two tasks by sharing features and utilizing appropriate multiple losses. In this way, our method can implicitly benefit from more surroundings to improve HPE accuracy while maintaining head detection performance. We present comprehensive comparisons with state-of-the-art single HPE methods on public benchmarks, as well as superior baseline results on our constructed MPHPE datasets. Datasets and code are released in <a class="link-external link-https" href="https://github.com/hnuzhy/DirectMHP" rel="external noopener nofollow">this https URL</a>.

Lphd: A Large-Scale Head Pose Dataset For Rgb Images

2DHeadPose: A simple and effective annotation method for the head pose in RGB images and its dataset

FDN: Feature Decoupling Network for Head Pose Estimation.

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

An Effective Deep Network for Head Pose Estimation without Keypoints

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Dataset

Event-based Head Pose Estimation: Benchmark and Method

Semi-Supervised Unconstrained Head Pose Estimation in the Wild

DirectMHP: Direct 2D Multi-Person Head Pose Estimation with Full-range Angles

Deep Learning-Based Human Pose Estimation: A Survey

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Hand Pose Understanding with Large-Scale Photo-Realistic Rendering Dataset

ARHPE: Asymmetric Relation-aware Representation Learning for Head Pose Estimation in Industrial Human-machine Interaction

Deep-learning-based head pose estimation from a single RGB image and its application to medical CROM measurement

RT-Pose: A 4D Radar Tensor-based 3D Human Pose Estimation and Localization Benchmark

Head Pose Estimation through Keypoints Matching between Reconstructed 3D Face Model and 2D Image

Deep High-Resolution Representation Learning For Human Pose Estimation

Joint Head Pose and Facial Landmark Regression from Depth Images