Abstract:3D content creation is referred to as one of the most fundamental tasks of computer graphics. And many 3D modeling algorithms from 2D images or curves have been developed over the past several decades. Designers are allowed to align some conceptual images or sketch some suggestive curves, from front, side, and top views, and then use them as references in constructing a 3D model automatically or manually. However, to the best of our knowledge, no studies have investigated on 3D human body reconstruction in a similar manner. In this paper, we propose a deep learning based reconstruction of 3D human body shape from 2D orthographic views. A novel CNN-based regression network, with two branches corresponding to frontal and lateral views respectively, is designed for estimating 3D human body shape from 2D mask images. We train our networks separately to decouple the feature descriptors which encode the body parameters from different views, and fuse them to estimate an accurate human body shape. In addition, to overcome the shortage of training data required for this purpose, we propose some significantly data augmentation schemes for 3D human body shapes, which can be used to promote further research on this topic. Extensive experimen- tal results demonstrate that visually realistic and accurate reconstructions can be achieved effectively using our algorithm. Requiring only binary mask images, our method can help users create their own digital avatars quickly, and also make it easy to create digital human body for 3D game, virtual reality, online fashion shopping.

Detailed Avatar Recovery from Single Image

Detailed Human Shape Estimation From A Single Image By Hierarchical Mesh Deformation

High-Fidelity Human Avatars from a Single RGB Camera

High-Fidelity Clothed Avatar Reconstruction from a Single Image

Detailed Human Avatars from Monocular Video

3D Human Reconstruction from A Single Depth Image

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

Shape-from-Mask: A Deep Learning Based Human Body Shape Reconstruction from Binary Mask Images

Deep Textured 3D Reconstruction of Human Bodies

Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition

3D human avatar reconstruction with neural fields: A recent survey

HAVE-FUN: Human Avatar Reconstruction from Few-Shot Unconstrained Images

MVP-Human Dataset for 3D Human Avatar Reconstruction from Unconstrained Frames

HybridAvatar: Efficient Mesh-based Human Avatar Generation from Few-Shot Monocular Images with Implicit Mesh Displacement

End-to-end Recovery of Human Shape and Pose

MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videos

TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies

Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Function

Detailed Garment Recovery from a Single-View Image

Human Mesh Recovery from Arbitrary Multi-view Images

Relightable and Animatable Neural Avatar from Sparse-View Video