Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Unsupervised Domain Adaptation for Micro-Doppler Human Motion Classification Via Feature Fusion

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Privacy-Preserving and Cross-Domain Human Sensing by Federated Domain Adaptation with Semantic Knowledge Correction

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

HOMDA: High-Order Moment-Based Domain Alignment for Unsupervised Domain Adaptation

Hierarchical Domain Adaptation with Local Feature Patterns

A Weight-aware-based Multi-source Unsupervised Domain Adaptation Method for Human Motion Intention Recognition

Unsupervised Domain Adaptation for Disguised-gait-based Person Identification on Micro-Doppler Signatures

Unsupervised Domain Adaptation for Device-free Gesture Recognition

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Unsupervised domain adaptation based on cluster matching and Fisher criterion for image classification

Unsupervised Domain Adaptation for Inter-Session Re-Calibration of Ultrasound-Based HMIs

Learning Transferable and Discriminative Features for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation for RF-based Gesture Recognition

Deep Joint Discriminative Feature Learning and Class-Aware Domain Alignment for Unsupervised Domain Adaptation

Cross-domain Human Motion Recognition

Eliminate Aspect Angle Variations for Human Activity Recognition using Unsupervised Deep Adaptation Network

Unsupervised domain adaptation via discriminative feature learning and classifier adaptation from center-based distances

A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network

Unsupervised Domain Adaptation for SAR Target Detection