Abstract:In this paper we present a novel real-time algorithm for simultaneous pose and shape estimation for articulated objects, such as human beings and animals. The key of our pose estimation component is to embed the articulated deformation model with exponential-maps-based parametrization into a Gaussian Mixture Model. Benefiting from this probabilistic measurement model, our algorithm requires no explicit point correspondences as opposed to most existing methods. Consequently, our approach is less sensitive to local minimum and handles fast and complex motions well. Moreover, our novel shape adaptation algorithm based on the same probabilistic model automatically captures the shape of the subjects during the dynamic pose estimation process. The personalized shape model in turn improves the tracking accuracy. Furthermore, we propose novel approaches to use either a mesh model or a sphere-set model as the template for both pose and shape estimation under this unified framework. Extensive evaluations on publicly available data sets demonstrate that our method outperforms most state-of-the-art pose estimation algorithms with large margin, especially in the case of challenging motions. Furthermore, our shape estimation method achieves comparable accuracy with state of the arts, yet requires neither statistical shape model nor extra calibration procedure. Our algorithm is not only accurate but also fast, we have implemented the entire processing pipeline on GPU. It can achieve up to 60 frames per second on a middle-range graphics card.

Track Articulated Body Motion by Pose-Model Based Stochastic Search

A Decentralized Probabilistic Approach to Articulated Body Tracking

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Tracking Articulated Body by Dynamic Markov Network

An efficient stochastic framework for 3D human motion tracking

2D Articulated Pose Tracking Using Particle Filter with Partitioned Sampling and Model Constraints

2d Articulated Tracking With Dynamic Bayesian Networks

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Monocular 3d Tracking of Articulated Human Motion in Silhouette and Pose Manifolds

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Model-based 3D human motion tracking and voxel reconstruction from sparse views

Real-Time Automatic Kinematic Model Building For Optical Motion Capture Using A Markov Random Field

Articulated Human Motion Tracking by Sequential Annealed Particle Swarm Optimization.

A Hybrid Framework for 3-D Human Motion Tracking

Human motion tracking based on shape analysis

Articulated pose identification with sparse point features

Real-Time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera

An Adaptive Approach to Human Motion Tracking from Video

Articulated motion reconstruction from feature points

Multi-Person Pose Tracking With Sparse Key-Point Flow Estimation and Hierarchical Graph Distance Minimization

Multi-view tracking of articulated human motion in silhouette and pose manifolds