Abstract:To combine the advantages of deterministic and probabilistic 3D human pose estimation methods, we decompose pose estimation into two processes: hypotheses generation and hypotheses aggregation. For hypotheses generation, we propose a novel Diffusion-based 3D Pose generation (D3DP) method. D3DP generates a diversified group of plausible 3D pose hypotheses from a single 2D keypoint observation. Utilizing a diffusion process, it gradually transforms ground-truth 3D poses towards a random distribution, subsequently employing a conditioned denoiser guided by the observed keypoints to recover the uncorrupted 3D poses. Moreover, D3DP is compatible with existing deterministic 3D pose estimators and allows users to optimize the trade-off between computational efficiency and pose accuracy via two adjustable parameters. For hypotheses aggregation, we propose two alternative approaches: a Reprojection-Based Selection (RBS) method and a Hypotheses Selection Network (HSN). These methods adopt the joint-level strategy to assemble multiple hypotheses generated by D3DP into a single 3D pose for practical use. Specifically, RBS reprojects 3D pose hypotheses to the 2D camera plane, and selects the best hypothesis based on the reprojection errors. HSN evaluates each hypothesis and selects the hypothesis with the highest confidence score as the output. Then these selected joints are combined into the final pose. The proposed methods implement a joint-by-joint aggregation strategy that capitalizes on the 2D prior and temporal information, both of which have been ignored by previous pose-level methods. Extensive experiments on two benchmarks highlight that the proposed method outperforms the state-of-the-art deterministic and probabilistic approaches.

Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Diffusion-Based Pose Refinement and Multi-Hypothesis Generation for 3D Human Pose Estimation

Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton

Diffusion-Based Hypotheses Generation and Joint-Level Hypotheses Aggregation for 3D Human Pose Estimation

Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregation

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Di^2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation

MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation

Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery

Evaluating 3D Human Pose Estimation in Occluded Multi-Sensor Scenarios: Dataset and Annotation Approach

Platypose: Calibrated Zero-Shot Multi-Hypothesis 3D Human Motion Estimation

3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views

ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation

EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans

Robust Estimation of 3D Human Poses from a Single Image

MHPro: Multi-hypothesis Probabilistic Modeling for Human Mesh Recovery

Multi Hybrid Extractor Network for 3D Human Pose Estimation

HDPose: Post-Hierarchical Diffusion with Conditioning for 3D Human Pose Estimation

3D Human Pose Estimation with 2D Human Pose and Depthmap

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network