Abstract:In this article, we present a sequential approach for articulated motion estimation from a 2D skeleton sequence. This is a challenging task due to the complexity of human movements and the inherent depth ambiguities. The proposed approach models the human movement on a kinematic manifold with the tangent bundle, which is a natural geometrical representation of articulated motion. Combined with a second-order stochastic dynamic model based on the Markov hypothesis, we generalize the Extended Rauch Tung Striebel smoother to a Riemannian manifold to simulate the process of human movement. The human motor system might violate the Markov hypothesis when the human body is subject to external forces, and therefore a refinement stage is introduced to correct the estimation error. Specifically, the current estimation is refined in a feasible solution region consisting of a set of local estimations. This region is called a simplex, in which each element can be represented by a convex hull of all ingredients. We have proved that the refinement problem can be converted into a convex optimization problem with the simplicial constraint. Since the proposed formulation conforms to the principles of kinematic and spatio-temporal continuity of articulated motion, the reconstruction ambiguity can be alleviated essentially. The performance of the proposed algorithm is conducted on multiple synthetic sequences from the CMU and the HDM05 MoCap databases. The results show that, without requiring any training data, the proposed approach achieves greater accuracy over state-ofthe-art baselines. Furthermore, the proposed approach outperforms two baselines on real sequences from the Human3.6m MoCap database.

Towards robust 3d reconstruction of human motion from monocular video

Efficient 3D Recovery of Human Motion in Monocular Video

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Shape of Motion: 4D Reconstruction from a Single Video

Automatic reconstruction of 3D human motion pose from uncalibrated monocular video sequences based on markerless human motion tracking

MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency

Video Motion Capture by Silhouette Analysis and Pose Optimization

Robust 3D Human Motion Reconstruction Via Dynamic Template Construction

RECONSTRUCTION OF 3D HUMAN MOTION POSE FROM UNCALIBRATED MONOCULAR VIDEO SEQUENCES

Sequential Articulated Motion Reconstruction from a Monocular Image Sequence

Robust Camera Motion Estimation in Video Sequences

Enhanced Spatio-Temporal Context for Temporally Consistent Robust 3D Human Motion Recovery from Monocular Videos

VidSfM: Robust and Accurate Structure-From-Motion for Monocular Videos.

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Efficient Human Motion Reconstruction from Monocular Videos with Physical Consistency Loss.

Capturing Complex 3d Human Motions With Kernelized Low-Rank Representation From Monocular Rgb Camera

Tracking 3D Human Motion in Compact Base Space

Monocular 3D Reconstruction of Human Body

MonoPerfCap

Markerless 3D Human Motion Tracking for Monocular Video Sequences