Abstract:In this article, we present a sequential approach for articulated motion estimation from a 2D skeleton sequence. This is a challenging task due to the complexity of human movements and the inherent depth ambiguities. The proposed approach models the human movement on a kinematic manifold with the tangent bundle, which is a natural geometrical representation of articulated motion. Combined with a second-order stochastic dynamic model based on the Markov hypothesis, we generalize the Extended Rauch Tung Striebel smoother to a Riemannian manifold to simulate the process of human movement. The human motor system might violate the Markov hypothesis when the human body is subject to external forces, and therefore a refinement stage is introduced to correct the estimation error. Specifically, the current estimation is refined in a feasible solution region consisting of a set of local estimations. This region is called a simplex, in which each element can be represented by a convex hull of all ingredients. We have proved that the refinement problem can be converted into a convex optimization problem with the simplicial constraint. Since the proposed formulation conforms to the principles of kinematic and spatio-temporal continuity of articulated motion, the reconstruction ambiguity can be alleviated essentially. The performance of the proposed algorithm is conducted on multiple synthetic sequences from the CMU and the HDM05 MoCap databases. The results show that, without requiring any training data, the proposed approach achieves greater accuracy over state-ofthe-art baselines. Furthermore, the proposed approach outperforms two baselines on real sequences from the Human3.6m MoCap database.

3D Articulated Structure and Motion Analysis from Monocular Images

Motion Analysis of Articulated Objects from Monocular Images.

3D Structure and Motion Estimation for Articulated Objects

Articulated Joint Estimation From Motion Using Two Monocular Images

Motion Estimation Of Articulated Objects From Perspective Views

Sequential Articulated Motion Reconstruction from a Monocular Image Sequence

Motion Imitation of a Humanoid Robot Via Pose Estimation

Articulated motion estimation from a monocular image sequence using spherical tangent bundles

SM<sup>3</sup>: Self-supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects

3D Articulated Skeleton Extraction Using a Single Consumer-Grade Depth Camera.

SM$^3$: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation

Human motion segmentation using collaborative representations of 3D skeletal sequences.

A Relaxation Method To Articulated Trajectory Reconstruction From Monocular Image Sequence

Learning Articulated Motions From Visual Demonstration

Capturing Complex 3d Human Motions With Kernelized Low-Rank Representation From Monocular Rgb Camera

Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data

Articulated motion reconstruction from feature points