Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Smoothness-based consistency learning for macaque pose estimation

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Relative Pose Consistency for Semi-Supervised Head Pose Estimation

Humble Teacher and Eager Student: Dual Network Learning for Semi-supervised 2D Human Pose Estimation

MonkeyPosekit: Automated Markerless 2D Pose Estimation of Monkey

Boosting Semi-Supervised 2D Human Pose Estimation by Revisiting Data Augmentation and Consistency Training

DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistency

Improving Multiperson Pose Estimation by Mask-aware Deep Reinforcement Learning

MacaquePose: A Novel “In the Wild” Macaque Monkey Pose Dataset for Markerless Motion Capture

Deep Active Learning For Human Pose Estimation Via Consistency Weighted Core-Set Approach

DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency

Spatial and temporal consistency learning for monocular 6D pose estimation

Multi-Scale Structure-Aware Network for Human Pose Estimation

MH6D: Multi-Hypothesis Consistency Learning for Category-Level 6-D Object Pose Estimation

Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network

Semi-Supervised 2D Human Pose Estimation Driven by Position Inconsistency Pseudo Label Correction Module

Domain Adaptation for Head Pose Estimation Using Relative Pose Consistency

Combining detailed appearance and multi-scale representation: a structure-context complementary network for human pose estimation

Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss