Abstract:Human mesh recovery (HMR) is crucial in many computer vision applications; from health to arts and entertainment. HMR from monocular images has predominantly been addressed by deterministic methods that output a single prediction for a given 2D image. However, HMR from a single image is an ill-posed problem due to depth ambiguity and occlusions. Probabilistic methods have attempted to address this by generating and fusing multiple plausible 3D reconstructions, but their performance has often lagged behind deterministic approaches. In this paper, we introduce GenHMR, a novel generative framework that reformulates monocular HMR as an image-conditioned generative task, explicitly modeling and mitigating uncertainties in the 2D-to-3D mapping process. GenHMR comprises two key components: (1) a pose tokenizer to convert 3D human poses into a sequence of discrete tokens in a latent space, and (2) an image-conditional masked transformer to learn the probabilistic distributions of the pose tokens, conditioned on the input image prompt along with randomly masked token sequence. During inference, the model samples from the learned conditional distribution to iteratively decode high-confidence pose tokens, thereby reducing 3D reconstruction uncertainties. To further refine the reconstruction, a 2D pose-guided refinement technique is proposed to directly fine-tune the decoded pose tokens in the latent space, which forces the projected 3D body mesh to align with the 2D pose clues. Experiments on benchmark datasets demonstrate that GenHMR significantly outperforms state-of-the-art methods. Project website can be found at <a class="link-external link-https" href="https://m-usamasaleem.github.io/publication/GenHMR/GenHMR.html" rel="external noopener nofollow">this https URL</a>

MH‐HMR: Human mesh recovery from monocular images via multi‐hypothesis learning

MHPro: Multi-hypothesis Probabilistic Modeling for Human Mesh Recovery

In-Hand 3D Object Reconstruction from a Monocular RGB Video

GenHMR: Generative Human Mesh Recovery

Recovering 3D Human Mesh from Monocular Images: A Survey

Human Mesh Recovery from Arbitrary Multi-view Images

CenterHMR: Multi-Person Center-based Human Mesh Recovery

End-to-end Recovery of Human Shape and Pose

PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds

HyperGraph Based Human Mesh Hierarchical Representation and Reconstruction from a Single Image.

Visibility-Aware Human Mesh Recovery Via Balancing Dense Correspondence and Probability Model

InstaHMR: Instance-aware One-stage Multi-person Human Mesh Recovery.

Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation

MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation

Multi-view Human Body Mesh Translator

MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose

Simultaneously Recovering Multi-Person Meshes and Multi-View Cameras with Human Semantics

SimHMR: A Simple Query-based Framework for Parameterized Human Mesh Reconstruction

Synthetic Training for Monocular Human Mesh Recovery