Abstract:Point clouds-based 3D human pose estimation that aims to recover the 3D locations of human skeleton joints plays an important role in many AR/VR applications. The success of existing methods is generally built upon large scale data annotated with 3D human joints. However, it is a labor-intensive and error-prone process to annotate 3D human joints from input depth images or point clouds, due to the self-occlusion between body parts as well as the tedious annotation process on 3D point clouds. Meanwhile, it is easier to construct human pose datasets with 2D human joint annotations on depth images. To address this problem, we present a weakly supervised adversarial learning framework for 3D human pose estimation from point clouds. Compared to existing 3D human pose estimation methods from depth images or point clouds, we exploit both the weakly supervised data with only annotations of 2D human joints and fully supervised data with annotations of 3D human joints. In order to relieve the human pose ambiguity due to weak supervision, we adopt adversarial learning to ensure the recovered human pose is valid. Instead of using either 2D or 3D representations of depth images in previous methods, we exploit both point clouds and the input depth image. We adopt 2D CNN to extract 2D human joints from the input depth image, 2D human joints aid us in obtaining the initial 3D human joints and selecting effective sampling points that could reduce the computation cost of 3D human pose regression using point clouds network. The used point clouds network can narrow down the domain gap between the network input i.e. point clouds and 3D joints. Thanks to weakly supervised adversarial learning framework, our method can achieve accurate 3D human pose from point clouds. Experiments on the ITOP dataset and EVAL dataset demonstrate that our method can achieve state-of-the-art performance efficiently.

Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network

3D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images

Self-supervised Method for 3D Human Pose Estimation with Consistent Shape and Viewpoint Factorization.

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Weakly Supervised Adversarial Learning for 3D Human Pose Estimation from Point Clouds

Graph U-Shaped Network with Mapping-Aware Local Enhancement for Single-Frame 3D Human Pose Estimation

Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

Multi-View Pose Generator Based on Deep Learning for Monocular 3D Human Pose Estimation

Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approach

Position Constrained Network for 3D Human Pose Estimation

Weakly-supervised Transfer for 3D Human Pose Estimation in the Wild

An Adaptive Viewpoint Transformation Network for 3D Human Pose Estimation

Locally Connected Network for Monocular 3D Human Pose Estimation

Simplified-attention Enhanced Graph Convolutional Network for 3D human pose estimation

A Multi-scale Recalibrated Approach for 3D Human Pose Estimation.

Robust Estimation of 3D Human Poses from a Single Image

3D Human Pose Estimation Based on Multi View Information Fusion

C3P: Cross-Domain Pose Prior Propagation for Weakly Supervised 3D Human Pose Estimation.