Abstract:Optical motion capture (MOCAP) is a commonly used technology to record the motion of non-rigid objects with high accuracy in 3D space. However, the MOCAP data has to be processed further before it can be used. The scattered reconstructed motion data must constitute a human configuration by labelling process according to the predefined template, and the missing markers have to be reconstructed to produce a stable motion trajectory. In this work, we propose a novel labelling method for motion sequences. First, a novel graph matching method is employed to determine the connection relationship of the scattered motion data for a single frame. Then, Kalman filtering is used for tracking in the motion sequence. As for the challenge coming from missing markers, we propose a new motion data preprocessing method considering the bone length constraint, which represents the information of variation in the relative position of adjacent markers. The processed motion data is input into a Long-Short Term Memory (LSTM) model to recover the missing markers and de-noise the motion data. The experiment conducted on our own dataset proves that our labelling method achieves a similar effect to Cortex, which is a commonly used commercial motion data analysis software. The experiment on CMU dataset demonstrates that our missing marker reconstruction method can achieve an art-of-state result. The labelling code will be pulished on https://github.com/Lijianfang6930/Graph-Matching-for-Marker-Labelling

Automatic Gait Motion Capture with Missing-Marker Fillings

Automatic Marker Registration and Prediction Algorithm for Optical Motion Capture System

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Deep Detector and Optical Flow-based Tracking Approach of Facial Markers for Animation Capture

Markerless Motion Capture Using Appearance and Inertial Data

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Markers rectifying in the motion capture system.

Markerless Shape and Motion Capture From Multiview Video Sequences

Robust Facial Marker Tracking Based on a Synthetic Analysis of Optical Flows and the YOLO Network

Markerless 3D Human Motion Tracking for Monocular Video Sequences

Accurate realtime full-body motion capture using a single depth camera

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

Markless Detection and Tracking of the Leg Skeleton of Walking People

Graph Matching for Marker Labeling and Missing Marker Reconstruction with Bone Constraint by LSTM in Optical Motion Capture

Deep-Learning-Based Recovery of Missing Optical Marker Trajectories in 3D Motion Capture Systems

Approach of Scattered Data Processing for Optical Motion Capture

Markerless motion capture of multiple characters using multiview image segmentation

Forward Non-Rigid Motion Tracking for Facial Mocap

Markerless motion capture of interacting characters using multi-view image segmentation

Markerless Gait Analysis Based On A Single Rgb Camera