Abstract:Human mesh recovery (HMR) is crucial in many computer vision applications; from health to arts and entertainment. HMR from monocular images has predominantly been addressed by deterministic methods that output a single prediction for a given 2D image. However, HMR from a single image is an ill-posed problem due to depth ambiguity and occlusions. Probabilistic methods have attempted to address this by generating and fusing multiple plausible 3D reconstructions, but their performance has often lagged behind deterministic approaches. In this paper, we introduce GenHMR, a novel generative framework that reformulates monocular HMR as an image-conditioned generative task, explicitly modeling and mitigating uncertainties in the 2D-to-3D mapping process. GenHMR comprises two key components: (1) a pose tokenizer to convert 3D human poses into a sequence of discrete tokens in a latent space, and (2) an image-conditional masked transformer to learn the probabilistic distributions of the pose tokens, conditioned on the input image prompt along with randomly masked token sequence. During inference, the model samples from the learned conditional distribution to iteratively decode high-confidence pose tokens, thereby reducing 3D reconstruction uncertainties. To further refine the reconstruction, a 2D pose-guided refinement technique is proposed to directly fine-tune the decoded pose tokens in the latent space, which forces the projected 3D body mesh to align with the 2D pose clues. Experiments on benchmark datasets demonstrate that GenHMR significantly outperforms state-of-the-art methods. Project website can be found at <a class="link-external link-https" href="https://m-usamasaleem.github.io/publication/GenHMR/GenHMR.html" rel="external noopener nofollow">this https URL</a>

SimHMR: A Simple Query-based Framework for Parameterized Human Mesh Reconstruction

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos

MH‐HMR: Human mesh recovery from monocular images via multi‐hypothesis learning

A Robust Multi‐View System for High‐Fidelity Human Body Shape Reconstruction

MHPro: Multi-hypothesis Probabilistic Modeling for Human Mesh Recovery

HyperGraph Based Human Mesh Hierarchical Representation and Reconstruction from a Single Image.

Human Mesh Recovery from Arbitrary Multi-view Images

GenHMR: Generative Human Mesh Recovery

Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Images

Skeleton2Mesh - Kinematics Prior Injected Unsupervised Human Mesh Recovery.

End-to-end Recovery of Human Shape and Pose

Clip Fusion with Bi-level Optimization for Human Mesh Reconstruction from Monocular Videos

Simultaneously Recovering Multi-Person Meshes and Multi-View Cameras with Human Semantics

3DPMesh: An enhanced and novel approach for the reconstruction of 3D human meshes from a single 2D image

PSHuman: Photorealistic Single-view Human Reconstruction using Cross-Scale Diffusion

MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter Wave

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation

Keypoints-guided Lightweight Network for Single-view 3D Human Reconstruction

MI-Mesh

MeshPose: Unifying DensePose and 3D Body Mesh reconstruction