Abstract:Human motion data that are captured by the markers attached to an actor’s body have been widely used in many areas. However, occlusion caused by the actor’s body or clothing might make several markers missing for a period of time during the capture process, which highlights the need for motion recovery in the human motion capture process. In recent years, low-rank matrix completion and sparse coding have been used in many data-driven motion recovery methods. However, applying them directly to recover missing data is not effective because low rank is only a basic statistical property of human motion. In addition, the dictionary is usually learned and used in a complete feature space, while human motion must be recovered from an incomplete feature space. Moreover, low-rank matrix completion and sparse coding take advantage only of the statistical property and ignore another important property, i.e., the kinematic property of human motion. Inspired by coupled dictionary learning, we modify the traditional dictionary learning process and propose a new process for the special task of motion recovery. The new recovery process jointly utilizes statistical and kinematic information. Within the proposed method, we first learn a dictionary from a large number of complete–incomplete training frame pairs, to preserve the statistical information of motion data. Then, with the smoothness constraint and the bone-length constraint which take the kinematic information into recovery process, we recover motions using sparse representations of incomplete frames and a learned dictionary through an optimization model. Additionally, we employ two gradient-based optimization algorithms for dictionary learning and motion recovery. Extensive experiment results and comparisons with four other state-of-the-art methods demonstrate the effectiveness of the proposed method.

Predicting Missing Markers In Human Motion Capture Using L1-Sparse Representation

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Locally weighted PCA regression to recover missing markers in human motion data.

Human Motion Estimation from a Reduced Marker Set.

Missing Data Recovery for Human Mocap Data Based on A-LSTM and LS Constraint

Human Motion Recovery Utilizing Truncated Schatten P-Norm and Kinematic Constraints

Graph Matching for Marker Labeling and Missing Marker Reconstruction with Bone Constraint by LSTM in Optical Motion Capture

Human Motion Recovery Jointly Utilizing Statistical and Kinematic Information

Automatic Marker Registration and Prediction Algorithm for Optical Motion Capture System

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Automatic Gait Motion Capture with Missing-Marker Fillings

Human Motion Capture and Recognition Based on Sparse Inertial Sensor.

A Time Reversal Symmetry Based Real-time Optical Motion Capture Missing Marker Recovery Method

Nonlocal Low-Rank Regularization for Human Motion Recovery Based on Similarity Analysis.

Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction

Markerless Human Body Motion Capture Using Markov Random Field and Dynamic Graph Cuts

Capturing Complex 3d Human Motions With Kernelized Low-Rank Representation From Monocular Rgb Camera

Towards Accurate Markerless Human Shape and Pose Estimation over Time

Markers rectifying in the motion capture system.

New multi-view human motion capture framework