Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Multi-scale Recalibration with Advanced Geometry Constraints for 3D Human Pose Estimation

A Multi-scale Recalibrated Approach for 3D Human Pose Estimation.

Multi-Scale Supervised Network for Human Pose Estimation

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Multi-Scale Structure-Aware Network for Human Pose Estimation

Unsupervised Domain Adaptation for 3D Human Pose Estimation

3d Body Pose And Shape Estimation From Multi-View Images With Limb Geometric Constraint

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Position Constrained Network for 3D Human Pose Estimation

3D Human Pose Estimation with Cross-Modality Training and Multi-Scale Local Refinement

Anatomy and Geometry Constrained One-Stage Framework for 3D Human Pose Estimation.

Three-dimensional Human Pose Estimation Based on Spatio-Temporal Multi-Feature Fusion Network

Calibrated deep attention model for 3D pose estimation in the wild

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network

3D Human Pose Estimation in Motion Based on Multi-Stage Regression

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

Graph U-Shaped Network with Mapping-Aware Local Enhancement for Single-Frame 3D Human Pose Estimation

Research on 3D Human Pose Estimation Technique Based on Multi-View Information Fusion

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

Reconstructing 3D human pose and shape from a single image and sparse IMUs