Abstract:y In a conventional optical motion capture (MoCap) workflow, two processes are needed to turn captured raw marker sequences into correct skeletal animation sequences. Firstly, various tracking errors present in the markers must be fixed (cleaning or refining). Secondly, an agent skeletal mesh must be prepared for the actor/actress, and used to determine skeleton information from the markers (re-targeting or solving). The whole process, normally referred to as solving MoCap data, is extremely time-consuming, labor-intensive, and usually the most costly part of animation production. Hence, there is a great demand for automated tools in industry. In this work, we present MoCap-Solver, a production-ready neural solver for optical MoCap data. It can directly produce skeleton sequences and clean marker sequences from raw MoCap markers, without any tedious manual operations. To achieve this goal, our key idea is to make use of neural encoders concerning three key intrinsic components: the template skeleton, marker configuration and motion, and to learn to predict these latent vectors from imperfect marker sequences containing noise and errors. By decoding these components from latent vectors, sequences of clean markers and skeletons can be directly recovered. Moreover, we also provide a novel normalization strategy based on learning a pose-dependent marker reliability function, which greatly improves system robustness. Experimental results demonstrate that our algorithm consistently outperforms the state-of-the-art on both synthetic and real-world datasets.

A genetic algorithm approach to human motion capture data segmentation

Motionobject segmentation algorithm based on spatial-temporal information

Based on network probabilistic graph human pose segmentation algorithm

Gait analysis of human locomotion based on motion capture system

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Vision-Based Hand Motion Capture Using Genetic Algorithm

Optimization-based key frame extraction for motion capture animation

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

A group of novel approaches and a toolkit for motion capture data reusing

Articulated Human Motion Tracking Using Sequential Immune Genetic Algorithm

Automatic analysis of segmentwise locomotion details of Drosophila larva

Real-Time Human Segmentation Using Pose Skeleton Map

Segmentation of Human Motion Capture Data Based on Laplasse Eigenmaps.

Gesture Recognition Based on Adaptive Genetic Algorithm

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

MoCap-Solver: A Neural Solver for Optical Motion Capture Data

Efficient motion capture data recovery via relationship-aggregated graph network and temporal pattern reasoning

Groupwise Shape Registration on Raw Edge Sequence Via A Spatio-Temporal Generative Model.

Markerless motion capture of interacting characters using multi-view image segmentation