Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Pixel-Level Domain Adaptation for Real-to-Sim Object Pose Estimation

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Global Adaptation Meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation.

Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulation

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Sim-to-Real Grasp Detection with Global-to-Local RGB-D Adaptation

Cad-based Viewpoint Estimation of Texture-Less Object for Purposive Perception Using Domain Adaptation.

CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection

Domain Adaptation on Point Clouds for 6D Pose Estimation in Bin-Picking Scenarios

MSDA: Monocular Self-supervised Domain Adaptation for 6D Object Pose Estimation

Cross-Modal Domain Adaptation for Cost-Efficient Visual Reinforcement Learning

Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation

Improving synthetic 3D model-aided indoor image localization via domain adaptation

Category-Level 6-D Object Pose Estimation With Shape Deformation for Robotic Grasp Detection

Robotic picking in dense clutter via domain invariant learning from synthetic dense cluttered rendering

Confidence-and-Refinement Adaptation Model for Cross-Domain Semantic Segmentation

SuDA: Support-based Domain Adaptation for Sim2Real Motion Capture with Flexible Sensors

Domain adaptive pose estimation via multi-level alignment

Domain Adaptive Hand Pose Estimation Based on Self-Looping Adversarial Training Strategy

Sim-to-Real Domain Adaptation for Deformation Classification

Pixel-Level Domain Adaptation: A New Perspective for Enhancing Weakly Supervised Semantic Segmentation