Abstract:Markerless motion capture algorithms require a 3D body with properly personalized skeleton dimension and/or body shape and appearance to successfully track a person. Unfortunately, many tracking methods consider model personalization a different problem and use manual or semi-automatic model initialization, which greatly reduces applicability. In this paper, we propose a fully automatic algorithm that jointly creates a rigged actor model commonly used for animation - skeleton, volumetric shape, appearance, and optionally a body surface - and estimates the actor's motion from multi-view video input only. The approach is rigorously designed to work on footage of general outdoor scenes recorded with very few cameras and without background subtraction. Our method uses a new image formation model with analytic visibility and analytically differentiable alignment energy. For reconstruction, 3D body shape is approximated as Gaussian density field. For pose and shape estimation, we minimize a new edge-based alignment energy inspired by volume raycasting in an absorbing medium. We further propose a new statistical human body model that represents the body surface, volumetric Gaussian density, as well as variability in skeleton shape. Given any multi-view sequence, our method jointly optimizes the pose and shape parameters of this model fully automatically in a spatiotemporal way.

Markerless Human Body Motion Capture Using Markov Random Field and Dynamic Graph Cuts

Human Body Motion Capture Via 3d Graph-Cuts

Markerless Human Body Motion Capture Using Multiple Cameras

A New Algorithm for Human Motion Capture via 3D Active Contours

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

Model-based markerless human body motion capture using active contour

MODEL-BASEDMARKERLESS HUMAN BODY MOTION CAPTURE USINGMULTIPLE CAMERAS

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Voxel Data Based Marker-less Human Motion Capture Using Geometry Model

Multi-view Human Motion Capture with an Improved Deformation Skin Model

Markerless Body Motion Capturing for 3D Character Animation based on Multi-view Cameras

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Human Motion Estimation from a Reduced Marker Set.

New multi-view human motion capture framework

Using compact distance energy model to recover human pose in markerless motion capture

Real-Time Automatic Kinematic Model Building For Optical Motion Capture Using A Markov Random Field

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Markerless motion capture based on diffusion geometry and silhouettes

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Markerless Motion Capture of Human Body Using PSO with Single Depth Camera

Markerless Human Pose Estimation Using Image Features and Extremal Contour