Abstract:Whole-body pose estimation aims to regress human pose models that include the body, hand, and facial details from RGB images. While the task of whole-body mesh recovery has been extensively studied in recent literature, the focus has predominantly been on human mesh recovery for a single person, despite the frequent occurrence of multiple people in practical scenarios. Similar to body-only cases, such single-person whole-body pose estimation methods often fail in the multiple-people problem for two reasons: (i) Given the ambiguous bounding box, which could contain more than one instance, it is difficult for single-person-oriented methods to regress the body mesh model of the target person. (ii) Single-person pose estimation approaches neglect the person-person occlusions and the depth order among instances, thus generating interpenetrated models. In this paper, we propose the Multi-person Expressive POse (MEPO) model, which exploits expressive 3D human model reconstruction for multiple people. To our best knowledge, our model is the first multi-person whole-body mesh reconstruction model, which is intensified by heatmap, depthmap, and depth order loss. We propose the Heatmap Enhancement Net (HENet) to leverage the heatmap information to assist the model in concentrating on the target person in crowded multi-person cases, while the depthmap delivers depth information of the image. Furthermore, we impose a depth order loss to recover human mesh precisely for overlapped people. In our experiments, we evaluate our model on multiple challenging datasets, including AGORA, which consists of complex occlusions similar to real-world scenarios. Our method has a significant performance improvement compared with the state-of-the-art pose estimation methods.

MeshPose: Unifying DensePose and 3D Body Mesh reconstruction

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

End-to-end Recovery of Human Shape and Pose

3DPMesh: An enhanced and novel approach for the reconstruction of 3D human meshes from a single 2D image

PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos

Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose

A Robust Multi‐View System for High‐Fidelity Human Body Shape Reconstruction

Monocular Expressive 3D Human Reconstruction of Multiple People

Towards Robust RGB-D Human Mesh Recovery

Convolutional Mesh Regression for Single-Image Human Shape Reconstruction

A 3D Mesh-based Lifting-and-Projection Network for Human Pose Transfer

SimHMR: A Simple Query-based Framework for Parameterized Human Mesh Reconstruction

MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose

Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view

Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation

MH‐HMR: Human mesh recovery from monocular images via multi‐hypothesis learning

Synthetic Training for Monocular Human Mesh Recovery

3D Human Mesh Estimation from Virtual Markers

HyperGraph Based Human Mesh Hierarchical Representation and Reconstruction from a Single Image.

Skeleton2Mesh - Kinematics Prior Injected Unsupervised Human Mesh Recovery.

End-to-End Human Pose and Mesh Reconstruction with Transformers