Abstract:In this paper, we introduce Neural-ABC, a novel parametric model based on neural implicit functions that can represent clothed human bodies with disentangled latent spaces for identity, clothing, shape, and pose. Traditional mesh-based representations struggle to represent articulated bodies with clothes due to the diversity of human body shapes and clothing styles, as well as the complexity of poses. Our proposed model provides a unified framework for parametric modeling, which can represent the identity, clothing, shape and pose of the clothed human body. Our proposed approach utilizes the power of neural implicit functions as the underlying representation and integrates well-designed structures to meet the necessary requirements. Specifically, we represent the underlying body as a signed distance function and clothing as an unsigned distance function, and they can be uniformly represented as unsigned distance fields. Different types of clothing do not require predefined topological structures or classifications, and can follow changes in the underlying body to fit the body. Additionally, we construct poses using a controllable articulated structure. The model is trained on both open and newly constructed datasets, and our decoupling strategy is carefully designed to ensure optimal performance. Our model excels at disentangling clothing and identity in different shape and poses while preserving the style of the clothing. We demonstrate that Neural-ABC fits new observations of different types of clothing. Compared to other state-of-the-art parametric models, Neural-ABC demonstrates powerful advantages in the reconstruction of clothed human bodies, as evidenced by fitting raw scans, depth maps and images. We show that the attributes of the fitted results can be further edited by adjusting their identities, clothing, shape and pose codes. The dataset and trained parametric model will be available at https://ustc3dv.github.io/NeuralABC/.

Parametric Model Estimation for 3D Clothed Humans from Point Clouds

3D Body Shapes Estimation from Dressed-Human Silhouettes.

ESTIMATING HUMAN SHAPE UNDER CLOTHING FROM SINGLE FRONTAL VIEW POINT CLOUD OF A DRESSED HUMAN

Neural Point-based Shape Modeling of Humans in Challenging Clothing

3D Body Shapes Estimation from Dressed-Human Silhouettes

A Semantic Parametric Model for 3D Human Body Reshaping.

Implicit 3D Human Reconstruction Guided by Parametric Models and Normal Maps

The Power of Points for Modeling Humans in Clothing

Sequential 3D Human Pose and Shape Estimation from Point Clouds

Status of research on parametric methods for the reconstruction of 3D models of the human body for virtual fitting

Parametric Body Reconstruction Based on a Single Front Scan Point Cloud

Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing

CLOTH3D: Clothed 3D Humans

Neural-ABC: Neural Parametric Models for Articulated Body With Clothes

Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction

Skinning a Parameterization of Three-Dimensional Space for Neural Network Cloth

Innovative AI techniques for photorealistic 3D clothed human reconstruction from monocular images or videos: a survey

GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splatting

Balanced parametric body prior for implicit clothed human reconstruction from a monocular RGB

Estimation of 3D Body Shape and Clothing Measurements from Frontal- and Side-view Images