Abstract:Parametric 3D body models like SMPL only represent minimally-clothed people and are hard to extend to clothing because they have a fixed mesh topology and resolution. To address these limitations, recent work uses implicit surfaces or point clouds to model clothed bodies. While not limited by topology, such methods still struggle to model clothing that deviates significantly from the body, such as skirts and dresses. This is because they rely on the body to canonicalize the clothed surface by reposing it to a reference shape. Unfortunately, this process is poorly defined when clothing is far from the body. Additionally, they use linear blend skinning to pose the body and the skinning weights are tied to the underlying body parts. In contrast, we model the clothing deformation in a local coordinate space without canonicalization. We also relax the skinning weights to let multiple body parts influence the surface. Specifically, we extend point-based methods with a coarse stage, that replaces canonicalization with a learned pose-independent "coarse shape" that can capture the rough surface geometry of clothing like skirts. We then refine this using a network that infers the linear blend skinning weights and pose dependent displacements from the coarse representation. The approach works well for garments that both conform to, and deviate from, the body. We demonstrate the usefulness of our approach by learning person-specific avatars from examples and then show how they can be animated in new poses and motions. We also show that the method can learn directly from raw scans with missing data, greatly simplifying the process of creating realistic avatars. Code is available for research purposes at {\small\url{<a class="link-external link-https" href="https://qianlim.github.io/SkiRT" rel="external noopener nofollow">this https URL</a>}}.

Bottom-up Simplied RefineNet for Human Clothing Estimation

BCNet: Learning Body and Cloth Shape from A Single Image

Phase Contour Enhancement Network for Clothing Parsing

Application of Clothing Design Based on Computer Vision Technology Using Hybrid Graph Convolution Neural Network and Lotus Effect Optimization Algorithm

Topology-Preserved Human Reconstruction with Details

Clothes Keypoints Localization and Attribute Recognition Via Prior Knowledge.

Robust and Automatic Clothing Reconstruction Based on a Single RGB Image.

An Efficient Style Virtual Try on Network for Clothing Business Industry

Deep learning techniques in modern women’s smart clothing design

Toward Clothing Personalized Customization Multi-Perspective Silhouettes 3D Human Body Rapid Reconstruction

Neural 3D Clothes Retargeting from a Single Image

Modeling Realistic Clothing from a Single Image under Normal Guide.

Deep Garment Image Matting for a Virtual Try-on System.

Multi-keypoints matching network for clothing detection

Research and Application of 3D Clothing Design Based on Deep Learning

FFENet: Frequency-Spatial Feature Enhancement Network for Clothing Classification

Clothing recognition based on deep sparse convolutional neural network

Neural Point-based Shape Modeling of Humans in Challenging Clothing

A New Approach to Automatic Clothing Matting from Mannequins

Measuring and modeling human bodies with a novel relocatable mechatronic sensor-net

Implicit 3D Human Reconstruction Guided by Parametric Models and Normal Maps