Abstract:Markerless motion capture algorithms require a 3D body with properly personalized skeleton dimension and/or body shape and appearance to successfully track a person. Unfortunately, many tracking methods consider model personalization a different problem and use manual or semi-automatic model initialization, which greatly reduces applicability. In this paper, we propose a fully automatic algorithm that jointly creates a rigged actor model commonly used for animation - skeleton, volumetric shape, appearance, and optionally a body surface - and estimates the actor's motion from multi-view video input only. The approach is rigorously designed to work on footage of general outdoor scenes recorded with very few cameras and without background subtraction. Our method uses a new image formation model with analytic visibility and analytically differentiable alignment energy. For reconstruction, 3D body shape is approximated as Gaussian density field. For pose and shape estimation, we minimize a new edge-based alignment energy inspired by volume raycasting in an absorbing medium. We further propose a new statistical human body model that represents the body surface, volumetric Gaussian density, as well as variability in skeleton shape. Given any multi-view sequence, our method jointly optimizes the pose and shape parameters of this model fully automatically in a spatiotemporal way.

Markerless Body Motion Capturing for 3D Character Animation based on Multi-view Cameras

Markerless Human Body Motion Capture Using Multiple Cameras

Markerless motion capture of multiple characters using multiview image segmentation

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

Interactive Animation Generation of Virtual Characters Using Single RGB-D Camera

Multi-view Human Motion Capture with an Improved Deformation Skin Model

Animation Of 3d Characters From Single Depth Camera

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Human Motion Capture Using Wireless Inertial Sensors

Markerless Human Body Motion Capture Using Markov Random Field and Dynamic Graph Cuts

MODEL-BASEDMARKERLESS HUMAN BODY MOTION CAPTURE USINGMULTIPLE CAMERAS

Markerless motion capture of interacting characters using multi-view image segmentation

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Animation of 3D Human Model Using Markerless Motion Capture Applied To Sports

A Markless 3D Human Motion Data Acquisition Method Based on the Binocular Stereo Vision and Lightweight Open Pose Algorithm

Markerless Motion Capture of Human Body Using PSO with Single Depth Camera

Sketch-based skeleton-driven 2D animation and motion capture

New multi-view human motion capture framework

Human Body Motion Capture Via 3d Graph-Cuts

Model-based markerless human body motion capture using active contour