Abstract:Learning to reconstruct 3D garments is important for dressing 3D human bodies of different shapes in different poses. Previous works typically rely on 2D images as input, which however suffer from the scale and pose ambiguities. To circumvent the problems caused by 2D images, we propose a principled framework, Garment4D, that uses 3D point cloud sequences of dressed humans for garment reconstruction. Garment4D has three dedicated steps: sequential garments registration, canonical garment estimation, and posed garment reconstruction. The main challenges are two-fold: 1) effective 3D feature learning for fine details, and 2) capture of garment dynamics caused by the interaction between garments and the human body, especially for loose garments like skirts. To unravel these problems, we introduce a novel Proposal-Guided Hierarchical Feature Network and Iterative Graph Convolution Network, which integrate both high-level semantic features and low-level geometric features for fine details reconstruction. Furthermore, we propose a Temporal Transformer for smooth garment motions capture. Unlike non-parametric methods, the reconstructed garment meshes by our method are separable from the human body and have strong interpretability, which is desirable for downstream tasks. As the first attempt at this task, high-quality reconstruction results are qualitatively and quantitatively illustrated through extensive experiments. Codes are available at <a class="link-external link-https" href="https://github.com/hongfz16/Garment4D" rel="external noopener nofollow">this https URL</a>.

Virtual Garment Using Joint Landmark Prediction and Part Segmentation

3D Virtual Garment Modeling from RGB Images.

Toward Realistic Virtual Try-on Through Landmark Guided Shape Matching

Linking Garment with Person Via Semantically Associated Landmarks for Virtual Try-On

BCNet: Learning Body and Cloth Shape from A Single Image

Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems

Garment4D: Garment Reconstruction from Point Cloud Sequences

A computer-vision based framework for virtual 3D garment reconstruction

Detailed Garment Recovery from a Single-View Image

3D Body Shapes Estimation from Dressed-Human Silhouettes.

Sketch Based Garment Modeling on an Arbitrary View of a 3D Virtual Human Model

VTON-SCFA: A Virtual Try-On Network Based on the Semantic Constraints and Flow Alignment

Single-view 3D Garment Reconstruction using Neural Volumetric Rendering

NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garments

Fashion Pose Machine for Fashion Landmark Detection

SPnet: Estimating Garment Sewing Patterns from a Single Image

Fashion Landmark Detection in the Wild

GAN-Based Garment Generation Using Sewing Pattern Images

3D Garment Digitisation for Virtual Wardrobe Using a Commodity Depth Sensor.

DP-VTON: Toward Detail-Preserving Image-Based Virtual Try-on Network

Realistic Monocular-To-3d Virtual Try-On Via Multi-Scale Characteristics Capture