Abstract:We investigate the tracking of 2-D human poses in a video stream to determine the spatial configuration of body parts in each frame, but this is not a trivial task because people may wear different kinds of clothing and may move very quickly and unpredictably. The technology of pose estimation is typically applied, but it ignores the temporal context and cannot provide smooth, reliable tracking results. Therefore, we develop a tracking and estimation integrated model (TEIM) to fully exploit temporal information by integrating pose estimation with visual tracking. However, joint parsing of multiple articulated parts over time is difficult, because a full model with edges capturing all pairwise relationships within and between frames is loopy and intractable. In previous models, approximate inference was usually resorted to, but it cannot promise good results and the computational cost is large. We overcome these problems by exploring the idea of divide and conquer, which decomposes the full model into two much simpler tractable submodels. In addition, a novel two-step iteration strategy is proposed to efficiently conquer the joint parsing problem. Algorithmically, we design TEIM very carefully so that: 1) it enables pose estimation and visual tracking to compensate for each other to achieve desirable tracking results; 2) it is able to deal with the problem of tracking loss; and 3) it only needs past information and is capable of tracking online. Experiments are conducted on two public data sets in the wild with ground truth layout annotations, and the experimental results indicate the effectiveness of the proposed TEIM framework.

3D Pose Tracking Using a Recovered 3D Model.

3D head tracking using SIFT-based registration and scale invariant view-based appearance model

Three-dimensional head pose tracking using registration and multi-scale appearance model

3D Object Tracking for Rough Models.

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Geometric and appearance model based approach for head pose recovery in monocular image sequence

Tracking by Third-Order Tensor Representation.

Real-Time 3D Motion Tracking with Known Geometric Models

Efficient 3D Recovery of Human Motion in Monocular Video

Learning a Tracking and Estimation Integrated Graphical Model for Human Pose Tracking.

Dynamically Modulated Mask Sparse Tracking

An Effective Approach to 3D Deformable Surface Tracking

Robust Object Tracking Against Template Drift

An Efficient Iterative Pose Estimation Algorithm

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

SpatialTracker: Tracking Any 2D Pixels in 3D Space

Towards robust 3d reconstruction of human motion from monocular video

Templateless Non-Rigid Reconstruction and Motion Tracking with a Single RGB-D Camera.

Real-time 2(1/2)-D head pose recovery for model-based video-coding

Object Tracking Via Appearance Modeling and Sparse Representation

A Real-Time Method for Recovering 3D Faces from Monocular Video