Abstract:Training an accurate 3D human pose estimator often requires a large amount of 3D ground-truth data which is inefficient and costly to collect. Previous methods have either resorted to weakly supervised methods to reduce the demand of ground-truth data for training, or using synthetically-generated but photo-realistic samples to enlarge the training data pool. Nevertheless, the former methods mainly require either additional supervision, such as unpaired 3D ground-truth data, or the camera parameters in multiview settings. On the other hand, the latter methods require accurately textured models, illumination configurations and background which need careful engineering. To address these problems, we propose a domain adaptation framework with unsupervised knowledge transfer, which aims at leveraging the knowledge in multi-modality data of the easy-to-get synthetic depth datasets to better train a pose estimator on the real-world datasets. Specifically, the framework first trains two pose estimators on synthetically-generated depth images and human body segmentation masks with full supervision, while jointly learning a human body segmentation module from the predicted 2D poses. Subsequently, the learned pose estimator and the segmentation module are applied to the real-world dataset to unsupervisedly learn a new RGB image based 2D/3D human pose estimator. Here, the knowledge encoded in the supervised learning modules are used to regularize a pose estimator without ground-truth annotations. Comprehensive experiments demonstrate significant improvements over weakly supervised methods when no ground-truth annotations are available. Further experiments with ground-truth annotations show that the proposed framework can outperform state-of-the-art fully supervised methods. In addition, we conducted ablation studies to examine the impact of each loss term, as well as with different amount of supervisions signal.

Self-Supervised Learning for Human Pose Estimation in Sports

Efficient, Self-Supervised Human Pose Estimation with Inductive Prior Tuning

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration

A Systematic Review of the Application of Camera-Based Human Pose Estimation in the Field of Sport and Physical Exercise

Unsupervised Domain Adaptation for 3D Human Pose Estimation

3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views

Self-supervised 3D Human Pose Estimation from a Single Image

Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment

Semi-Supervised 2D Human Pose Estimation Driven by Position Inconsistency Pseudo Label Correction Module

Design Space Exploration on Efficient and Accurate Human Pose Estimation from Sparse IMU-Sensing

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Self-Supervised 3D Human Pose Estimation in Static Video Via Neural Rendering

Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition

Mining Automatically Estimated Poses from Video Recordings of Top Athletes

FollowMeUp Sports: New Benchmark for 2D Human Keypoint Recognition

Automatic human posture estimation for sport activity recognition with robust body parts detection and entropy markov model

Semi-Supervised Unconstrained Head Pose Estimation in the Wild

Human Posture Estimation and Sustainable Events Classification via Pseudo-2D Stick Model and K-ary Tree Hashing

ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Poses