Abstract:Human pose estimation via motion tracking systems can be considered as a regression problem within a discriminative framework. It is always a challenging task to model the mapping from observation space to state space because of the high-dimensional characteristic in the multimodal conditional distribution. In order to build the mapping, existing techniques usually involve a large set of training samples in the learning process which are limited in their capability to deal with multimodality. We propose, in this work, a novel online sparse Gaussian Process (GP) regression model to recover 3-D human motion in monocular videos. Particularly, we investigate the fact that for a given test input, its output is mainly determined by the training samples potentially residing in its local neighborhood and defined in the unified input-output space. This leads to a local mixture GP experts system composed of different local GP experts, each of which dominates a mapping behavior with the specific covariance function adapting to a local region. To handle the multimodality, we combine both temporal and spatial information therefore to obtain two categories of local experts. The temporal and spatial experts are integrated into a seamless hybrid system, which is automatically self-initialized and robust for visual tracking of nonlinear human motion. Learning and inference are extremely efficient as all the local experts are defined online within very small neighborhoods. Extensive experiments on two real-world databases, HumanEva and PEAR, demonstrate the effectiveness of our proposed model, which significantly improve the performance of existing models.

Model-based 3D human motion tracking and voxel reconstruction from sparse views

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

An accelerated human motion tracking system based on voxel reconstruction under complex environments

Tracking 3D Human Motion in Compact Base Space

An efficient stochastic framework for 3D human motion tracking

A Two-Stage Scheme for Multi-View Human Pose Estimation

Articulated Human Motion Tracking by Sequential Annealed Particle Swarm Optimization.

A Bayesian framework for 3D human motion tracking from monocular image

Monocular Tracking 3D People by Gaussian Process Spatio-Temporal Variable Model

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Digitize Your Body and Action in 3-D at Over 10 FPS: Real Time Dense Voxel Reconstruction and Marker-less Motion Tracking via GPU Acceleration.

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild

Generative Tracking of 3d Human Motion by Hierarchical Annealed Genetic Algorithm

Monocular 3d Tracking of Articulated Human Motion in Silhouette and Pose Manifolds

Human motion tracking by temporal-spatial local gaussian process experts

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

A Hybrid Framework for 3-D Human Motion Tracking

Spatio-Temporal Reconstruction for 3D Motion Recovery