Abstract:Human densepose estimation, aiming at establishing dense correspondences between 2D pixels of human body and 3D human body template, is a key technique in enabling machines to have an understanding of people in images. It still poses several challenges due to practical scenarios where real-world scenes are complex and only partial annotations are available, leading to incompelete or false estimations. In this work, we present a novel framework to detect the densepose of multiple people in an image. The proposed method, which we refer to Knowledge Transfer Network (KTN), tackles two main problems: 1) how to refine image representation for alleviating incomplete estimations, and 2) how to reduce false estimation caused by the low-quality training labels (i.e., limited annotations and class-imbalance labels). Unlike existing works directly propagating the pyramidal features of regions for densepose estimation, the KTN uses a refinement of pyramidal representation, where it simultaneously maintains feature resolution and suppresses background pixels, and this strategy results in a substantial increase in accuracy. Moreover, the KTN enhances the ability of 3D based body parsing with external knowledges, where it casts 2D based body parsers trained from sufficient annotations as a 3D based body parser through a structural body knowledge graph. In this way, it significantly reduces the adverse effects caused by the low-quality annotations. The effectiveness of KTN is demonstrated by its superior performance to the state-of-the-art methods on DensePose-COCO dataset. Extensive ablation studies and experimental results on representative tasks (e.g., human body segmentation, human part segmentation and keypoints detection) and two popular densepose estimation pipelines (i.e., RCNN and fully-convolutional frameworks), further indicate the generalizability of the proposed method.

Efficient Low-Resolution Human Pose Estimation with Knowledge Bridge

Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation

Online Knowledge Distillation for Efficient Pose Estimation

Integral Knowledge Distillation for Multi-Person Pose Estimation

Lightweight and Effective Human Pose Estimation Model Based on Multi-Angle Knowledge Distillation

Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation

Low-resolution human pose estimation

Pose Knowledge Transfer for Multi-Person Pose Estimation

Deep High-Resolution Representation Learning For Human Pose Estimation

Pyramid Knowledge Distillation for Efficient Human Pose Estimation.

Transfer Useful Knowledge for Headpose Estimation from Low Resolution Images

KTN: Knowledge Transfer Network for Learning Multiperson 2D-3D Correspondences

Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach

Efficient Human Pose Estimation in Hierarchical Context

Knowledge Distillation for Lightweight 2D Single-Person Pose Estimation

Efficient Low-Resolution Face Recognition via Bridge Distillation

Cross Refinement Techniques for Markerless Human Motion Capture

Focus on Low-Resolution Information: Multi-Granular Information-Lossless Model for Low-Resolution Human Pose Estimation

EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search

Learning high resolution reservation for human pose estimation

Learning with Privileged Stereo Knowledge for Monocular Absolute 3d Human Pose Estimation