Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Learning pose-invariant 3D object reconstruction from single-view images

Domain-Adaptive Single-View 3D Reconstruction

Shape-Pose Ambiguity in Learning 3D Reconstruction from Images.

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Adversarial learning for viewpoints invariant 3D human pose estimation.

Domain Adaptation for Real-World Single View 3D Reconstruction

Weakly Supervised Part-wise 3D Shape Reconstruction from Single-View RGB Images

Rethinking Reprojection: Closing the Loop for Pose-aware ShapeReconstruction from a Single Image

Dynamic Domain Adaptation for Single-view 3D Reconstruction

Look, Evolve and Mold: Learning 3D Shape Manifold Via Single-view Synthetic Data

DASI: Learning Domain Adaptive Shape Impression for 3D Object Reconstruction

Toward Realistic Single-View 3D Object Reconstruction with Unsupervised Learning from Multiple Images

Unsupervised Shape and Pose Disentanglement for 3D Meshes

Monocular 3D Face Reconstruction with Joint 2D and 3D Constraints

Learning Shape Priors for Single-View 3D Completion and Reconstruction

Adaptive 3D Face Reconstruction from a Single Image

When 3D Reconstruction Meets Ubiquitous RGB-D Images

Learning Hand-Held Object Reconstruction from In-The-Wild Videos

Single-view 3D Reconstruction Algorithm Based on View-aware

Category-Sensitive Incremental Learning for Image-Based 3D Shape Reconstruction

Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views