Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Recognizing body poses using multilinear analysis and semi-supervised learning

View-Invariant Pose Recognition Using Multilinear Analysis and the Universum

Binocular Full-Body Pose Recognition and Orientation Inference Using Multilinear Analysis

Binocular Dance Pose Recognition and Body Orientation Estimation via Multilinear Analysis

Unsupervised Domain Adaptation for 3D Human Pose Estimation

Human Pose Inference from Stereo Cameras

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Human Pose Regression Through Multiview Visual Fusion.

Multi-Person 3d Pose Estimation From Monocular Image Sequences

Bimodal Stereo: Joint Shape and Pose Estimation from Color-Depth Image Pair

Human Posture Tracking and Classification through Stereo Vision and 3D Model Matching

Multi-Pose Learning based Head-Shoulder Re-identification

Learning and Inference of 3D Human Poses from Gaussian Mixture Modeled Silhouettes

Multi-view Weakly-supervised 3D Human Pose Estimation for Depth Maps Via SoG with Semantic Segmentation Information

Discriminative Learning of Visual Words for 3D Human Pose Estimation

Human Pose Estimation with Regression by Fusing Multi-View Visual Information

Pose Estimation Based on Human Detection and Segmentation

Human Pose Estimation from Polluted Silhouettes Using Sub-manifold Voting Strategy

View-invariant Full-Body Gesture Recognition Via Multilinear Analysis of Voxel Data