Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Discriminator Adaptive Wasserstein Hourglass Regression Network Depth Regularizer Loss 2 . 5 D s Loss rec s Loss rec t Loss 2 D t Loss wd Feature Similarity Weighting Skip Connection

Adaptive Wasserstein Hourglass for Weakly Supervised Hand Pose Estimation from Monocular RGB

Adaptive Wasserstein Hourglass for Weakly Supervised RGB 3D Hand Pose Estimation

Global Adaptation Meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation.

Deep Joint Two-Stream Wasserstein Auto-Encoder and Selective Attention Alignment for Unsupervised Domain Adaptation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Domain Adaptive Hand Pose Estimation Based on Self-Looping Adversarial Training Strategy

Multibranch Adversarial Regression for Domain Adaptative Hand Pose Estimation

Weakly-Supervised 3d Hand Pose Estimation From Monocular Rgb Images

AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation

Enhanced 3D Pose Estimation in Multi-Person, Multi-View Scenarios through Unsupervised Domain Adaptation with Dropout Discriminator

3D Hand Pose Estimation Using Synthetic Data and Weakly Labeled RGB Images.

CbwLoss: Constrained Bidirectional Weighted Loss for Self-Supervised Learning of Depth and Pose

Learning Depth from Monocular Videos Using Synthetic Data: A Temporally-Consistent Domain Adaptation Approach

Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose

Learning Depth from Monocular Videos Using Synthetic Data: A Temporally-Consistent Domain Adaptation Approach

Joint Distribution Adaptation Via Wasserstein Adversarial Training.

DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images in 3D Hand Pose Estimation

Adv-Depth: Self-Supervised Monocular Depth Estimation with an Adversarial Loss.

Self-Supervised 3D Hand Pose Estimation from monocular RGB via Contrastive Learning