Abstract:Due to the inherent limitations of a single viewpoint, reconstructing 3D human meshes from a single image has long been a challenging task. While deep learning networks enable us to approximate the shape of unseen sides, capturing the texture details of the non-visible side remains difficult with just one image. Traditional methods utilize Generative Adversarial Networks (GANs) to predict the normal maps of the non-visible side, thereby inferring detailed textures and wrinkles on the model's surface. However, we have identified challenges with existing normal prediction networks when dealing with complex scenes, such as a lack of focus on local features and insufficient modeling of spatial relationships.To address these challenges, we introduce EMAR—Enhanced Multi-scale Attention-Driven Single-Image 3D Human Reconstruction. This approach incorporates a novel Enhanced Multi-Scale Attention (EMSA) mechanism, which excels at capturing intricate features and global relationships in complex scenes. EMSA surpasses traditional single-scale attention mechanisms by adaptively adjusting the weights between features, enabling the network to more effectively leverage information across various scales. Furthermore, we have improved the feature fusion method to better integrate representations from different scales. This enhanced feature fusion allows the network to more comprehensively understand both fine details and global structures within the image. Finally, we have designed a hybrid loss function tailored to the introduced attention mechanism and feature fusion method, optimizing the network's training process and enhancing the quality of reconstruction results. Our network demonstrates significant improvements in performance for 3D human model reconstruction. Experimental results show that our method exhibits greater robustness to challenging poses compared to traditional single-scale approaches.

Towards Efficient and Photorealistic 3D Human Reconstruction: A Brief Survey

Efficient Neural Implicit Representation for 3D Human Reconstruction

3D human avatar reconstruction with neural fields: A recent survey

3D Human Reconstruction from A Single Depth Image

A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation

HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction

3D Reconstruction From Traditional Methods to Deep Learning

3D Real Human Reconstruction Via Multiple Low-Cost Depth Cameras.

New Algorithm for 3d Facial Model Reconstruction and Its Application in Virtual Reality

Innovative AI techniques for photorealistic 3D clothed human reconstruction from monocular images or videos: a survey

Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Images

A Comprehensive Review of Vision-Based 3D Reconstruction Methods

Enhanced Multi-Scale Attention-Driven 3D Human Reconstruction from Single Image

PSHuman: Photorealistic Single-view Human Reconstruction using Cross-Scale Diffusion

Deep learning-based 3D reconstruction: a survey

3D Face Reconstruction Based on A Single Image: A Review

Detailed 3D Human Body Reconstruction from Multi-view Images Combining Voxel Super-Resolution and Learned Implicit Representation

A New Algorithm for 3d Facial Model Reconstruction and Its Application in Vr

HumanRecon: Neural Reconstruction of Dynamic Human Using Geometric Cues and Physical Priors.

Neural 3D Reconstruction in the Wild

Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment