Abstract:Human motion data that are captured by the markers attached to an actor’s body have been widely used in many areas. However, occlusion caused by the actor’s body or clothing might make several markers missing for a period of time during the capture process, which highlights the need for motion recovery in the human motion capture process. In recent years, low-rank matrix completion and sparse coding have been used in many data-driven motion recovery methods. However, applying them directly to recover missing data is not effective because low rank is only a basic statistical property of human motion. In addition, the dictionary is usually learned and used in a complete feature space, while human motion must be recovered from an incomplete feature space. Moreover, low-rank matrix completion and sparse coding take advantage only of the statistical property and ignore another important property, i.e., the kinematic property of human motion. Inspired by coupled dictionary learning, we modify the traditional dictionary learning process and propose a new process for the special task of motion recovery. The new recovery process jointly utilizes statistical and kinematic information. Within the proposed method, we first learn a dictionary from a large number of complete–incomplete training frame pairs, to preserve the statistical information of motion data. Then, with the smoothness constraint and the bone-length constraint which take the kinematic information into recovery process, we recover motions using sparse representations of incomplete frames and a learned dictionary through an optimization model. Additionally, we employ two gradient-based optimization algorithms for dictionary learning and motion recovery. Extensive experiment results and comparisons with four other state-of-the-art methods demonstrate the effectiveness of the proposed method.

Automatic motion capture data denoising via filtered subspace clustering and low rank matrix approximation.

Automatic Motion Capture Data Denoising via Filtered Local Subspace Affinity and Low Rank Approximation

Segmented Low Rank Approximation Approach for Motion Capture Data Denoising

Mining Spatial-Temporal Patterns and Structural Sparsity for Human Motion Data Denoising

A Rigid Structure Matching-Based Noise Data Processing Approach for Human Motion Capture

Sparse Motion Bases Selection for Human Motion Denoising

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Human Motion Segmentation Via Robust Kernel Sparse Subspace Clustering.

Exploiting temporal stability and low-rank structure for motion capture data refinement

Motion Capture Data Segmentation Based on Spectral Clustering

Motion Capture in Mixed-Reality Applications: A Deep Denoising Approach

Video denoising based on a spatiotemporal Kalman-bilateral mixture model

Human Motion Recovery Utilizing Truncated Schatten P-Norm and Kinematic Constraints

Meshflow Video Denoising

A Deep Recurrent Framework for Cleaning Motion Capture Data

Approach of Scattered Data Processing for Optical Motion Capture

Forward Non-Rigid Motion Tracking for Facial Mocap

Video-Based Human Motion Capture Data Retrieval Via MotionSet Network

MoCap-Solver: A Neural Solver for Optical Motion Capture Data

Human Motion Recovery Jointly Utilizing Statistical and Kinematic Information

Multihypothesis Recursive Video Denoising Based on Separation of Motion State