Abstract:2D articulated human pose tracking in monocular image sequences remains an extremely challenging task due to background cluttering, variation in body appearance, occlusion and imaging conditions. Most of the current approaches only deal with simple appearance and adjacent or connected body part dependencies, especially the tree-structured priors assumed over body part connections. Such prior excludes the dependencies between non-connected body parts which could actually contribute to tracking accuracies. Building on the successful pictorial structures model, we propose a novel framework for human pose tracking including more dependencies of non-connected body parts. In order to implement inference efficiently for the proposed model, we introduce a factor graph to factorize all the unary term and all dependencies that are modelled in the pairwise term of the proposed model. In this paper, we also observe that the posterior marginals of each part from the tree structure model satisfy a Gaussian distribution. Based on this property, the sampling procedure becomes straight-forward and the search space can be shrunk effectively. We incorporate a simple motion constraint to capture the temporal continuity of body parts between frames, since the positions/orientations of body parts usually change smoothly between consecutive frames. In addition, we introduce a full body detector as the first step of our framework to reduce the search space for pose tracking. We also exploit the temporal continuity of body parts between frames by incorporating constraints on the location distance and the orientation difference for each body part between two successive frames. We evaluate our framework on two challenging image sequences and conduct a series of experiments to compare the performance with the approaches based on the tree-based model. The results illustrate that the proposed framework improves the performance significantly.

Human Body Tracking Using LMS-VSMM from Monocular Video Sequences

3D Human Body Tracking in Unconstrained Scenes

Visual Tracking Via Subspace Motion Model

An Adaptive Approach to Human Motion Tracking from Video

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Markerless 3D Human Motion Tracking for Monocular Video Sequences

Monocular Human Motion Tracking with Non-Connected Body Part Dependency.

An Unsupervised Real-Time Framework of Human Pose Tracking from Range Image Sequences.

Monocular video based markerless 3D human pose estimation by using Local Multi-connected Belief Propagation with multi-cue fusion

A Robust Framework for 2D Human Pose Tracking with Spatial and Temporal Constraints

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Human motion tracking based on shape analysis

2-D Model Based Tracking of Human Motion

A Multi-model Human Motion Tracking Approach with Wearable IMU Sensors

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

Track Articulated Body Motion by Pose-Model Based Stochastic Search

Markerless Human Body Motion Capture Using Multiple Cameras

Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment

Geometrical kinematic modeling on human motion using method of multi-sensor fusion

Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

3D Human Body Shape and Motion Tracking by LBS and Snake