Abstract:Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale in-studio datasets remains questionable, as these models often perform unsatisfactorily on unseen in-the-wild environments. Though weakly-supervised models have been proposed to address this shortcoming, performance of such models relies on availability of paired supervision on some related tasks, such as 2D pose or multi-view image pairs. In contrast, we propose a novel kinematic-structure-preserved unsupervised 3D pose estimation framework, which is not restrained by any paired or unpaired weak supervisions. Our pose estimation framework relies on a minimal set of prior knowledge that defines the underlying kinematic 3D structure, such as skeletal joint connectivity information with bone-length ratios in a fixed canonical scale. The proposed model employs three consecutive differentiable transformations named as forward-kinematics, camera-projection and spatial-map transformation. This design not only acts as a suitable bottleneck stimulating effective pose disentanglement but also yields interpretable latent pose representations avoiding training of an explicit latent embedding to pose mapper. Furthermore, devoid of unstable adversarial setup, we re-utilize the decoder to formalize an energy-based loss, which enables us to learn from in-the-wild videos, beyond laboratory settings. Comprehensive experiments demonstrate our state-of-the-art unsupervised and weakly-supervised pose estimation performance on both Human3.6M and MPI-INF-3DHP datasets. Qualitative results on unseen environments further establish our superior generalization ability.

SDM3d: Shape Decomposition of Multiple Geometric Priors for 3D Pose Estimation

Joint Representation of Multiple Geometric Priors via a Shape Decomposition Model for Single Monocular 3D Pose Estimation.

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

SMAP: Single-Shot Multi-person Absolute 3D Pose Estimation

Towards Locality Similarity Preserving to 3D Human Pose Estimation.

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

Anatomy and Geometry Constrained One-Stage Framework for 3D Human Pose Estimation.

SD-Pose: Semantic Decomposition for Cross-Domain 6D Object Pose Estimation

MMDA: Multi-person marginal distribution awareness for monocular 3D pose estimation

Reweighted Sparse Representation with Residual Compensation for 3D Human Pose Estimation from a Single RGB Image

Kinematic-Structure-Preserved Representation for Unsupervised 3D Human Pose Estimation

Robust Estimation of 3D Human Poses from a Single Image

A Geometric Approach to Joint 2D Region-Based Segmentation and 3D Pose Estimation Using a 3D Shape Prior

3D Human Body Shape and Pose Estimation from Depth Image.

Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modeling

3D Human Pose and Shape Estimation with Dense Correspondence from a Single Depth Image

Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video

Learning 3-D Human Pose Estimation from Catadioptric Videos

Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation

3D Human Pose Estimation from Multiple Dynamic Views Via Single-view Pretraining with Procrustes Alignment

Position Constrained Network for 3D Human Pose Estimation