Abstract:In this article, we present a sequential approach for articulated motion estimation from a 2D skeleton sequence. This is a challenging task due to the complexity of human movements and the inherent depth ambiguities. The proposed approach models the human movement on a kinematic manifold with the tangent bundle, which is a natural geometrical representation of articulated motion. Combined with a second-order stochastic dynamic model based on the Markov hypothesis, we generalize the Extended Rauch Tung Striebel smoother to a Riemannian manifold to simulate the process of human movement. The human motor system might violate the Markov hypothesis when the human body is subject to external forces, and therefore a refinement stage is introduced to correct the estimation error. Specifically, the current estimation is refined in a feasible solution region consisting of a set of local estimations. This region is called a simplex, in which each element can be represented by a convex hull of all ingredients. We have proved that the refinement problem can be converted into a convex optimization problem with the simplicial constraint. Since the proposed formulation conforms to the principles of kinematic and spatio-temporal continuity of articulated motion, the reconstruction ambiguity can be alleviated essentially. The performance of the proposed algorithm is conducted on multiple synthetic sequences from the CMU and the HDM05 MoCap databases. The results show that, without requiring any training data, the proposed approach achieves greater accuracy over state-ofthe-art baselines. Furthermore, the proposed approach outperforms two baselines on real sequences from the Human3.6m MoCap database.

Reconstruction of segmentally articulated structure in freeform movement with low density feature points

Articulated motion reconstruction from feature points

Articulated pose identification with sparse point features

Articulated point pattern matching in optical motion capture systems

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

TC-SfM: Robust Track-Community-Based Structure-from-Motion

Motion Analysis of Articulated Objects from Monocular Images.

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

Sequential Articulated Motion Reconstruction from a Monocular Image Sequence

Templateless Non-Rigid Reconstruction and Motion Tracking with a Single RGB-D Camera.

Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

Learning Implicit Representation for Reconstructing Articulated Objects

Recovering Articulated Object Models from 3D Range Data

Robust single-view geometry and motion reconstruction

Reconstructing Non-Rigid Object with Large Movement Using a Single Depth Camera.

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Articulated Object Registration Using Simulated Physical Force/Moment For 3d Human Motion Tracking

Long-Range Motion Trajectories Extraction of Articulated Human Using Mesh Evolution

3-D MOTION RECOVERY VIA LOW RANK MATRIX RESTORATION ON ARTICULATION GRAPHS