Abstract:Due to the inherent limitations of a single viewpoint, reconstructing 3D human meshes from a single image has long been a challenging task. While deep learning networks enable us to approximate the shape of unseen sides, capturing the texture details of the non-visible side remains difficult with just one image. Traditional methods utilize Generative Adversarial Networks (GANs) to predict the normal maps of the non-visible side, thereby inferring detailed textures and wrinkles on the model's surface. However, we have identified challenges with existing normal prediction networks when dealing with complex scenes, such as a lack of focus on local features and insufficient modeling of spatial relationships.To address these challenges, we introduce EMAR—Enhanced Multi-scale Attention-Driven Single-Image 3D Human Reconstruction. This approach incorporates a novel Enhanced Multi-Scale Attention (EMSA) mechanism, which excels at capturing intricate features and global relationships in complex scenes. EMSA surpasses traditional single-scale attention mechanisms by adaptively adjusting the weights between features, enabling the network to more effectively leverage information across various scales. Furthermore, we have improved the feature fusion method to better integrate representations from different scales. This enhanced feature fusion allows the network to more comprehensively understand both fine details and global structures within the image. Finally, we have designed a hybrid loss function tailored to the introduced attention mechanism and feature fusion method, optimizing the network's training process and enhancing the quality of reconstruction results. Our network demonstrates significant improvements in performance for 3D human model reconstruction. Experimental results show that our method exhibits greater robustness to challenging poses compared to traditional single-scale approaches.

Image-Guided Human Reconstruction via Multi-Scale Graph Transformation Networks

3D Human Reconstruction from A Single Depth Image

Topology-Preserved Human Reconstruction with Details

HyperGraph Based Human Mesh Hierarchical Representation and Reconstruction from a Single Image.

MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose

Enhanced Multi-Scale Attention-Driven 3D Human Reconstruction from Single Image

Hierarchical Graph Networks for 3D Human Pose Estimation

DeepHuman: 3D Human Reconstruction from a Single Image

Detailed 3D Human Body Reconstruction from a Single Image Based on Mesh Deformation

A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Pose

Dual-Branch Graph Transformer Network for 3D Human Mesh Reconstruction from Video

Keypoints-guided Lightweight Network for Single-view 3D Human Reconstruction

DC-GNet: Deep Mesh Relation Capturing Graph Convolution Network for 3D Human Shape Reconstruction

DIMNet: Dense Implicit Function Network for 3D Human Body Reconstruction.

Multi-view Shape Generation for a 3D Human-like Body

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation

ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction

PSHuman: Photorealistic Single-view Human Reconstruction using Cross-Scale Diffusion

Single-image Human Mesh Reconstruction by Parallel Spatial Feature Aggregation.

A Modular Multi-stage Lightweight Graph Transformer Network for Human Pose and Shape Estimation from 2D Human Pose

Joint 3D Human Shape Recovery and Pose Estimation from a Single Image with Bilayer Graph