Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Mask-based Object Pose Estimation with Domain Transfer

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Unseen Object Pose Estimation via Registration

Temporal Consistent Object Pose Estimation from Monocular Videos

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Deep Learning-Based 6-DoF Object Pose Estimation Considering Synthetic Dataset

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Pose Mask: A Model-Based Augmentation Method for 2D Pose Estimation in Classroom Scenes Using Surveillance Images

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

A Segmentation-Driven Approach for 6D Object Pose Estimation in the Crowd

Multi-Human Pose Estimation by Deep Learning-Based Sequential Approach for Human Keypoint Position and Human Body Detection

Mask6D: Masked Pose Priors for 6D Object Pose Estimation.

Improving Multiperson Pose Estimation by Mask-aware Deep Reinforcement Learning

Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation

Pose Estimation of Multiple Domains Based on the Fusion of Multiple Deep Learning Models and Baidu API

An Improved Estimation Algorithm of Space Targets Pose Based on Multi-Modal Feature Fusion

Domain Adaptation on Point Clouds for 6D Pose Estimation in Bin-Picking Scenarios

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

ProcNet: Deep Predictive Coding Model for Robust-to-occlusion Visual Segmentation and Pose Estimation