Abstract:We consider the problem of estimating 3-D human body pose from visual signals within a discriminative framework. It is challenging because there is a wide gap between complex 3-D human motion and planar visual observation, which makes this a severely ill-conditioned problem. In this paper, we focus on three critical factors to tackle human body pose estimation, namely, feature extraction, learning algorithm, and camera utilization. On the feature level, we describe images using the salient interest points represented by scale-invariant feature transform (SIFT)-like descriptors, in which the position, appearance, and local structural information are encoded simultaneously. On the learning algorithm level, we propose to use Gaussian processes and multiple linear (ML) regression to model the mapping between poses and features. Fusing image information from multiple cameras in different views is of great interest to us on the camera level. We make a comprehensive evaluation on the HumanEva database and get two meaningful insights into the three crucial aspects for human pose estimation: 1) although the choice of feature is very important to the problem, once the learning algorithm becomes efficient, the choice of feature is no longer critical, and 2) the impact of information combination from multiple cameras on pose estimation is closely related to not only the quantity of image information, but also its quality. In most cases, it is true that the more information is involved, the better results can be achieved. But when the information quantity is the same, the differences in quality will lead to totally different performance. Furthermore, dense evaluations demonstrate that our approach is an accurate and robust solution to the human body pose estimation problem.

Regression-Based Face Pose Estimation with Deep Multi-modal Feature Loss.

Multi-modal Face Pose Estimation with Multi-task Manifold Deep Learning

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Mixture Of Deep Regression Networks For Head Pose Estimation

MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction

Regression-Based Camera Pose Estimation through Multi-Level Local Features and Global Features

Accurate Head Pose Estimation Based on Multi-Stage Regression.

Multi-Scale Supervised Network for Human Pose Estimation

Multimodal Deep Autoencoder for Human Pose Recovery

Three-Dimensional Face Pose Estimation Based on Novel Nonlinear Discriminant Representation

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

Face Pose Estimation and Synthesis by 2D Morphable Model

Multi-Scale Structure-Aware Network for Human Pose Estimation

Human Pose Estimation with Regression by Fusing Multi-View Visual Information

Facial Representation Extraction by Mutual Information Maximization and Correlation Minimization.

Face Pose Estimate and Multi-pose Synthesize by 2D Morphable Model

Human Pose Regression Through Multiview Visual Fusion.

Deep Dual Consecutive Network for Human Pose Estimation

Exploiting Multi-modal Fusion for Robust Face Representation Learning with Missing Modality

Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning