Abstract:Due to the inherent limitations of a single viewpoint, reconstructing 3D human meshes from a single image has long been a challenging task. While deep learning networks enable us to approximate the shape of unseen sides, capturing the texture details of the non-visible side remains difficult with just one image. Traditional methods utilize Generative Adversarial Networks (GANs) to predict the normal maps of the non-visible side, thereby inferring detailed textures and wrinkles on the model's surface. However, we have identified challenges with existing normal prediction networks when dealing with complex scenes, such as a lack of focus on local features and insufficient modeling of spatial relationships.To address these challenges, we introduce EMAR—Enhanced Multi-scale Attention-Driven Single-Image 3D Human Reconstruction. This approach incorporates a novel Enhanced Multi-Scale Attention (EMSA) mechanism, which excels at capturing intricate features and global relationships in complex scenes. EMSA surpasses traditional single-scale attention mechanisms by adaptively adjusting the weights between features, enabling the network to more effectively leverage information across various scales. Furthermore, we have improved the feature fusion method to better integrate representations from different scales. This enhanced feature fusion allows the network to more comprehensively understand both fine details and global structures within the image. Finally, we have designed a hybrid loss function tailored to the introduced attention mechanism and feature fusion method, optimizing the network's training process and enhancing the quality of reconstruction results. Our network demonstrates significant improvements in performance for 3D human model reconstruction. Experimental results show that our method exhibits greater robustness to challenging poses compared to traditional single-scale approaches.

HEAT: Holistic Edge Attention Transformer for Structured Reconstruction

CornerFormer: Boosting Corner Representation for Fine-Grained Structured Reconstruction

EdgeNAT: Transformer for Efficient Edge Detection

Floorplan Restoration by Structure Hallucinating Transformer Cascades

Tensorformer: Normalized Matrix Attention Transformer for High-quality Point Cloud Reconstruction

DSAT-Net: Dual Spatial Attention Transformer for Building Extraction From Aerial Images

3D Neural Edge Reconstruction

Edge-Aware Attention Transformer for Image Super-Resolution

Raster‐to‐Graph: Floorplan Recognition via Autoregressive Graph Prediction with an Attention Transformer

EAR: Edge-Aware Reconstruction of 3-D vertebrae structures from bi-planar X-ray images

High-Quality Textured 3D Shape Reconstruction with Cascaded Fully Convolutional Networks

FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans

Fast MRI Reconstruction via Edge Attention

EDTER: Edge Detection with Transformer

EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

Optimized Vectorizing of Building Structures With Switch: High-Efficiency Convolutional Channel-Switch Hybridization Strategy

High-Dimensional Phase Space Reconstruction with a Convolutional Neural Network for Structural Health Monitoring

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detection

Enhanced Multi-Scale Attention-Driven 3D Human Reconstruction from Single Image

Joint multi-dimensional dynamic attention and transformer for general image restoration