Abstract:In this paper, we introduce Neural-ABC, a novel parametric model based on neural implicit functions that can represent clothed human bodies with disentangled latent spaces for identity, clothing, shape, and pose. Traditional mesh-based representations struggle to represent articulated bodies with clothes due to the diversity of human body shapes and clothing styles, as well as the complexity of poses. Our proposed model provides a unified framework for parametric modeling, which can represent the identity, clothing, shape and pose of the clothed human body. Our proposed approach utilizes the power of neural implicit functions as the underlying representation and integrates well-designed structures to meet the necessary requirements. Specifically, we represent the underlying body as a signed distance function and clothing as an unsigned distance function, and they can be uniformly represented as unsigned distance fields. Different types of clothing do not require predefined topological structures or classifications, and can follow changes in the underlying body to fit the body. Additionally, we construct poses using a controllable articulated structure. The model is trained on both open and newly constructed datasets, and our decoupling strategy is carefully designed to ensure optimal performance. Our model excels at disentangling clothing and identity in different shape and poses while preserving the style of the clothing. We demonstrate that Neural-ABC fits new observations of different types of clothing. Compared to other state-of-the-art parametric models, Neural-ABC demonstrates powerful advantages in the reconstruction of clothed human bodies, as evidenced by fitting raw scans, depth maps and images. We show that the attributes of the fitted results can be further edited by adjusting their identities, clothing, shape and pose codes. The dataset and trained parametric model will be available at https://ustc3dv.github.io/NeuralABC/.

NeCH: Neural Clothed Human Model

MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images

ReN Human: Learning Relightable Neural Implicit Surfaces for Animatable Human Rendering

Neural Point-based Shape Modeling of Humans in Challenging Clothing

NSF: Neural Surface Fields for Human Modeling from Monocular Depth

LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies

Topology-Preserved Human Reconstruction with Details

BCNet: Learning Body and Cloth Shape from A Single Image

Neural Capture of Animatable 3D Human from Monocular Video.

Neural-ABC: Neural Parametric Models for Articulated Body With Clothes

SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes

NECA: Neural Customizable Human Avatar

Deformable Model for Estimating Clothed and Naked Human Shapes from a Single Image

Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis

HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images

Implicit Neural Representations With Structured Latent Codes for Human Body Modeling

Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans

Dynamic Appearance Modeling of Clothed 3D Human Avatars using a Single Camera