Abstract:Due to the inherent limitations of a single viewpoint, reconstructing 3D human meshes from a single image has long been a challenging task. While deep learning networks enable us to approximate the shape of unseen sides, capturing the texture details of the non-visible side remains difficult with just one image. Traditional methods utilize Generative Adversarial Networks (GANs) to predict the normal maps of the non-visible side, thereby inferring detailed textures and wrinkles on the model's surface. However, we have identified challenges with existing normal prediction networks when dealing with complex scenes, such as a lack of focus on local features and insufficient modeling of spatial relationships.To address these challenges, we introduce EMAR—Enhanced Multi-scale Attention-Driven Single-Image 3D Human Reconstruction. This approach incorporates a novel Enhanced Multi-Scale Attention (EMSA) mechanism, which excels at capturing intricate features and global relationships in complex scenes. EMSA surpasses traditional single-scale attention mechanisms by adaptively adjusting the weights between features, enabling the network to more effectively leverage information across various scales. Furthermore, we have improved the feature fusion method to better integrate representations from different scales. This enhanced feature fusion allows the network to more comprehensively understand both fine details and global structures within the image. Finally, we have designed a hybrid loss function tailored to the introduced attention mechanism and feature fusion method, optimizing the network's training process and enhancing the quality of reconstruction results. Our network demonstrates significant improvements in performance for 3D human model reconstruction. Experimental results show that our method exhibits greater robustness to challenging poses compared to traditional single-scale approaches.

SHARE: Single-view Human Adversarial REconstruction

Adversarial learning for viewpoints invariant 3D human pose estimation.

STN-enhanced Message Passing Guided by Adversarial Learning for Human Pose Estimation

Rethinking Reprojection: Closing the Loop for Pose-aware ShapeReconstruction from a Single Image

When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks

Personalized 3D Human Pose and Shape Refinement

Confidence sharing adaptation for out-of-domain human pose and shape estimation

Adversarial Learning Enhancement for 3D Human Pose and Shape Estimation

End-to-end Recovery of Human Shape and Pose

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

Reconstructing 3D human pose and shape from a single image and sparse IMUs

Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Images

Towards Robust 3D Pose Transfer with Adversarial Learning

RePOSE: 3D Human Pose Estimation Via Spatio-Temporal Depth Relational Consistency

Enhanced Multi-Scale Attention-Driven 3D Human Reconstruction from Single Image

Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery

SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation

Reconstructing 3D Human Pose by Watching Humans in the Mirror

Optimising 2D Pose Representation: Improve Accuracy, Stability and Generalisability Within Unsupervised 2D-3D Human Pose Estimation

Adapted Human Pose: Monocular 3D Human Pose Estimation with Zero Real 3D Pose Data

3D Human Pose, Shape and Texture from Low-Resolution Images and Videos