Abstract:Human motion data that are captured by the markers attached to an actor’s body have been widely used in many areas. However, occlusion caused by the actor’s body or clothing might make several markers missing for a period of time during the capture process, which highlights the need for motion recovery in the human motion capture process. In recent years, low-rank matrix completion and sparse coding have been used in many data-driven motion recovery methods. However, applying them directly to recover missing data is not effective because low rank is only a basic statistical property of human motion. In addition, the dictionary is usually learned and used in a complete feature space, while human motion must be recovered from an incomplete feature space. Moreover, low-rank matrix completion and sparse coding take advantage only of the statistical property and ignore another important property, i.e., the kinematic property of human motion. Inspired by coupled dictionary learning, we modify the traditional dictionary learning process and propose a new process for the special task of motion recovery. The new recovery process jointly utilizes statistical and kinematic information. Within the proposed method, we first learn a dictionary from a large number of complete–incomplete training frame pairs, to preserve the statistical information of motion data. Then, with the smoothness constraint and the bone-length constraint which take the kinematic information into recovery process, we recover motions using sparse representations of incomplete frames and a learned dictionary through an optimization model. Additionally, we employ two gradient-based optimization algorithms for dictionary learning and motion recovery. Extensive experiment results and comparisons with four other state-of-the-art methods demonstrate the effectiveness of the proposed method.

3-D MOTION RECOVERY VIA LOW RANK MATRIX RESTORATION ON ARTICULATION GRAPHS

3D Motion Recovery Via Low Rank Matrix Restoration with Hankel-Like Augmentation

3-D Motion Recovery Via Low Rank Matrix Analysis

Spatio-Temporal Reconstruction for 3D Motion Recovery

3-D Skeleton Recovery via Sparse Representation

Human Motion Recovery Utilizing Truncated Schatten P-Norm and Kinematic Constraints

Sequential Articulated Motion Reconstruction from a Monocular Image Sequence

Nonlocal Low-Rank Regularization for Human Motion Recovery Based on Similarity Analysis.

Nonlinear Low-Rank Matrix Completion for Human Motion Recovery.

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videos

Human Motion Recovery Jointly Utilizing Statistical and Kinematic Information

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Robust 3D Human Motion Reconstruction Via Dynamic Template Construction

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Real-time non-rigid shape recovery via active appearance models for augmented reality

Efficient 3D Recovery of Human Motion in Monocular Video

Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data

Articulated motion reconstruction from feature points

MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency

Graph Matching for Marker Labeling and Missing Marker Reconstruction with Bone Constraint by LSTM in Optical Motion Capture