Abstract:In this paper, we present a stochastic framework for articulated 3D human motion tracking. Tracking full body human motion is a challenging task, because the tracking performance normally suffers from several issues such as self-occlusion; foreground segmentation noise and high computational cost. In our work, we use explicit 3D reconstructions of the human body based on a visual hull algorithm as our system input, which effectively eliminates self-occlusion. To improve tracking efficiency as well as robustness, we use a Kalman particle filter framework based on an interacting multiple model (IMM). The posterior density is approximated by a set of weighted particles, which include both sample means and covariances. Therefore, tracking is equivalent to searching the maximum a posteriori (MAP) of the probability distribution. During Kalman filtering, several dynamical models of human motion (e.g., zero order, first order) are assumed which interact with each other for more robust tracking results. Our measurement step is performed by a local optimization method using simulated physical force/moment for 3D registration. The likelihood function is designed to be the fitting score between the reconstructed human body and our 3D human model, which is composed of a set of cylinders. This proposed tracking framework is tested on a real motion sequence. Our experimental results show that the proposed method improves the sampling efficiency compared with most particle filter based methods and achieves high tracking accuracy.

Real-Time Automatic Kinematic Model Building For Optical Motion Capture Using A Markov Random Field

Autonomous Real-Time Model Building for Optical Motion Capture

Markerless Human Body Motion Capture Using Markov Random Field and Dynamic Graph Cuts

Automatic Marker Registration and Prediction Algorithm for Optical Motion Capture System

Real-time Physics-based Motion Capture with Sparse Sensors

High-Accuracy Real-Time Whole-Body Human Motion Tracking Based on Constrained Nonlinear Kalman Filtering

Accurate realtime full-body motion capture using a single depth camera

Tracking Articulated Body by Dynamic Markov Network

Approach of Scattered Data Processing for Optical Motion Capture

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

A Markless 3D Human Motion Data Acquisition Method Based on the Binocular Stereo Vision and Lightweight Open Pose Algorithm

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

MODEL-BASEDMARKERLESS HUMAN BODY MOTION CAPTURE USINGMULTIPLE CAMERAS

A Real-Time Inverse Kinematics Algorithm for Human Motion Modeling

Ambulatory Real-Time Micro-Sensor Motion Capture

Noise-in, Bias-out: Balanced and Real-time MoCap Solving

Optical Unmarked Motion Capture Technology Based on Depth Network and Binocular Vision

Markerless Human Body Motion Capture Using Multiple Cameras

Markerless Motion Capture Using Appearance and Inertial Data

An efficient stochastic framework for 3D human motion tracking

Track Articulated Body Motion by Pose-Model Based Stochastic Search