Abstract:Human motion data that are captured by the markers attached to an actor’s body have been widely used in many areas. However, occlusion caused by the actor’s body or clothing might make several markers missing for a period of time during the capture process, which highlights the need for motion recovery in the human motion capture process. In recent years, low-rank matrix completion and sparse coding have been used in many data-driven motion recovery methods. However, applying them directly to recover missing data is not effective because low rank is only a basic statistical property of human motion. In addition, the dictionary is usually learned and used in a complete feature space, while human motion must be recovered from an incomplete feature space. Moreover, low-rank matrix completion and sparse coding take advantage only of the statistical property and ignore another important property, i.e., the kinematic property of human motion. Inspired by coupled dictionary learning, we modify the traditional dictionary learning process and propose a new process for the special task of motion recovery. The new recovery process jointly utilizes statistical and kinematic information. Within the proposed method, we first learn a dictionary from a large number of complete–incomplete training frame pairs, to preserve the statistical information of motion data. Then, with the smoothness constraint and the bone-length constraint which take the kinematic information into recovery process, we recover motions using sparse representations of incomplete frames and a learned dictionary through an optimization model. Additionally, we employ two gradient-based optimization algorithms for dictionary learning and motion recovery. Extensive experiment results and comparisons with four other state-of-the-art methods demonstrate the effectiveness of the proposed method.

A Time Reversal Symmetry Based Real-time Optical Motion Capture Missing Marker Recovery Method

Deep-Learning-Based Recovery of Missing Optical Marker Trajectories in 3D Motion Capture Systems

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Missing Data Recovery for Human Mocap Data Based on A-LSTM and LS Constraint

Graph Matching for Marker Labeling and Missing Marker Reconstruction with Bone Constraint by LSTM in Optical Motion Capture

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Automatic Gait Motion Capture with Missing-Marker Fillings

3-D MOTION RECOVERY VIA LOW RANK MATRIX RESTORATION ON ARTICULATION GRAPHS

Markers rectifying in the motion capture system.

A Deep Bi-directional Attention Network for Human Motion Recovery.

Automatic Marker Registration and Prediction Algorithm for Optical Motion Capture System

Acquisition of Time-Varying 3D Foot Shapes from Video

Spatio-Temporal Reconstruction for 3D Motion Recovery

Deep Detector and Optical Flow-based Tracking Approach of Facial Markers for Animation Capture

Human Motion Recovery Jointly Utilizing Statistical and Kinematic Information

Efficient motion capture data recovery via relationship-aggregated graph network and temporal pattern reasoning

Efficient Human Motion Recovery Using Bidirectional Attention Network.

Markerless Shape and Motion Capture From Multiview Video Sequences

Markerless Motion Capture Using Appearance and Inertial Data

Robust Facial Marker Tracking Based on a Synthetic Analysis of Optical Flows and the YOLO Network