Abstract:Human pose estimation via motion tracking systems can be considered as a regression problem within a discriminative framework. It is always a challenging task to model the mapping from observation space to state space because of the high-dimensional characteristic in the multimodal conditional distribution. In order to build the mapping, existing techniques usually involve a large set of training samples in the learning process which are limited in their capability to deal with multimodality. We propose, in this work, a novel online sparse Gaussian Process (GP) regression model to recover 3-D human motion in monocular videos. Particularly, we investigate the fact that for a given test input, its output is mainly determined by the training samples potentially residing in its local neighborhood and defined in the unified input-output space. This leads to a local mixture GP experts system composed of different local GP experts, each of which dominates a mapping behavior with the specific covariance function adapting to a local region. To handle the multimodality, we combine both temporal and spatial information therefore to obtain two categories of local experts. The temporal and spatial experts are integrated into a seamless hybrid system, which is automatically self-initialized and robust for visual tracking of nonlinear human motion. Learning and inference are extremely efficient as all the local experts are defined online within very small neighborhoods. Extensive experiments on two real-world databases, HumanEva and PEAR, demonstrate the effectiveness of our proposed model, which significantly improve the performance of existing models.

Tracking Generic Human Motion Via Fusion of Low- and High-Dimensional Approaches

Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Towards Human Motion Tracking: Multi-Sensory IMU/TOA Fusion Method and Fundamental Limits

A Hybrid Framework for 3-D Human Motion Tracking

Adaptive fusion of particle filtering and spatio-temporal motion energy for human tracking

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

Monocular 3d Tracking of Articulated Human Motion in Silhouette and Pose Manifolds

Multiview 3-D Human Motion Tracking with Information Fusion Sampling

An efficient stochastic framework for 3D human motion tracking

Motion-Driven Tracking via End-to-End Coarse-to-Fine Verifying

Upper Limb Motion Tracking with the Integration of IMU and Kinect

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

FusionTrack: Multiple Object Tracking with Enhanced Information Utilization

Human motion tracking by temporal-spatial local gaussian process experts

Geometrical kinematic modeling on human motion using method of multi-sensor fusion

Multi-view tracking of articulated human motion in silhouette and pose manifolds

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

Tracking 3D Human Motion in Compact Base Space

DFSTrack: Dual-stream fusion Siamese network for human pose tracking in videos