Abstract:2D articulated human pose tracking in monocular image sequences remains an extremely challenging task due to background cluttering, variation in body appearance, occlusion and imaging conditions. Most of the current approaches only deal with simple appearance and adjacent or connected body part dependencies, especially the tree-structured priors assumed over body part connections. Such prior excludes the dependencies between non-connected body parts which could actually contribute to tracking accuracies. Building on the successful pictorial structures model, we propose a novel framework for human pose tracking including more dependencies of non-connected body parts. In order to implement inference efficiently for the proposed model, we introduce a factor graph to factorize all the unary term and all dependencies that are modelled in the pairwise term of the proposed model. In this paper, we also observe that the posterior marginals of each part from the tree structure model satisfy a Gaussian distribution. Based on this property, the sampling procedure becomes straight-forward and the search space can be shrunk effectively. We incorporate a simple motion constraint to capture the temporal continuity of body parts between frames, since the positions/orientations of body parts usually change smoothly between consecutive frames. In addition, we introduce a full body detector as the first step of our framework to reduce the search space for pose tracking. We also exploit the temporal continuity of body parts between frames by incorporating constraints on the location distance and the orientation difference for each body part between two successive frames. We evaluate our framework on two challenging image sequences and conduct a series of experiments to compare the performance with the approaches based on the tree-based model. The results illustrate that the proposed framework improves the performance significantly.

3D Human Body Tracking in Unconstrained Scenes

Monocular Human Motion Tracking with Non-Connected Body Part Dependency.

An efficient stochastic framework for 3D human motion tracking

A Robust Framework for 2D Human Pose Tracking with Spatial and Temporal Constraints

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Human Body Tracking Using LMS-VSMM from Monocular Video Sequences

Markerless 3D Human Motion Tracking for Monocular Video Sequences

Monocular 3d Tracking of Articulated Human Motion in Silhouette and Pose Manifolds

Adaptive Particle Filter With Body Part Segmentation For Full Body Tracking

2d Articulated Tracking With Dynamic Bayesian Networks

A Bayesian framework for 3D human motion tracking from monocular image

An Adaptive Approach to Human Motion Tracking from Video

2D Articulated Pose Tracking Using Particle Filter with Partitioned Sampling and Model Constraints

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Tracking People by Predicting 3D Appearance, Location & Pose

Tracking 3D Human Motion in Compact Base Space

Monocular video based markerless 3D human pose estimation by using Local Multi-connected Belief Propagation with multi-cue fusion

Multi-Person Pose Tracking With Sparse Key-Point Flow Estimation and Hierarchical Graph Distance Minimization

Monocular Tracking 3D People by Gaussian Process Spatio-Temporal Variable Model

Video Pose Track with Graph-Guided Sparse Motion Estimation