Abstract:Human motion data that are captured by the markers attached to an actor’s body have been widely used in many areas. However, occlusion caused by the actor’s body or clothing might make several markers missing for a period of time during the capture process, which highlights the need for motion recovery in the human motion capture process. In recent years, low-rank matrix completion and sparse coding have been used in many data-driven motion recovery methods. However, applying them directly to recover missing data is not effective because low rank is only a basic statistical property of human motion. In addition, the dictionary is usually learned and used in a complete feature space, while human motion must be recovered from an incomplete feature space. Moreover, low-rank matrix completion and sparse coding take advantage only of the statistical property and ignore another important property, i.e., the kinematic property of human motion. Inspired by coupled dictionary learning, we modify the traditional dictionary learning process and propose a new process for the special task of motion recovery. The new recovery process jointly utilizes statistical and kinematic information. Within the proposed method, we first learn a dictionary from a large number of complete–incomplete training frame pairs, to preserve the statistical information of motion data. Then, with the smoothness constraint and the bone-length constraint which take the kinematic information into recovery process, we recover motions using sparse representations of incomplete frames and a learned dictionary through an optimization model. Additionally, we employ two gradient-based optimization algorithms for dictionary learning and motion recovery. Extensive experiment results and comparisons with four other state-of-the-art methods demonstrate the effectiveness of the proposed method.

Mining Spatial-Temporal Patterns and Structural Sparsity for Human Motion Data Denoising

Sparse Motion Bases Selection for Human Motion Denoising

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Automatic motion capture data denoising via filtered subspace clustering and low rank matrix approximation.

Human Motion Segmentation Via Robust Kernel Sparse Subspace Clustering.

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

Segmented Low Rank Approximation Approach for Motion Capture Data Denoising

Multi-Task Spatial-Temporal Graph Auto-Encoder for Hand Motion Denoising.

Automatic Motion Capture Data Denoising via Filtered Local Subspace Affinity and Low Rank Approximation

A Rigid Structure Matching-Based Noise Data Processing Approach for Human Motion Capture

Human Motion Recovery Jointly Utilizing Statistical and Kinematic Information

Motion Capture in Mixed-Reality Applications: A Deep Denoising Approach

Motion-DVAE: Unsupervised learning for fast human motion denoising

Physics-Guided Human Motion Capture with Pose Probability Modeling

Human Motion Capture and Recognition Based on Sparse Inertial Sensor.

3D Dynamic Point Cloud Denoising via Spatial-Temporal Graph Learning

A Deep Recurrent Framework for Cleaning Motion Capture Data

Meshflow Video Denoising

Dense Non-Rigid Structure-from-motion Made Easy — A Spatial-Temporal Smoothness Based Solution

Self-Calibration Flow Guided Denoising Diffusion Model for Human Pose Transfer