ClothCombo: Modeling Inter-Cloth Interaction for Draping Multi-Layered Clothes

Dohae Lee,Hyun Kang,In-Kwon Lee

2023-11-30

Abstract:We present ClothCombo, a pipeline to drape arbitrary combinations of clothes on 3D human models with varying body shapes and poses. While existing learning-based approaches for draping clothes have shown promising results, multi-layered clothing remains challenging as it is non-trivial to model inter-cloth interaction. To this end, our method utilizes a GNN-based network to efficiently model the interaction between clothes in different layers, thus enabling multi-layered clothing. Specifically, we first create feature embedding for each cloth using a topology-agnostic network. Then, the draping network deforms all clothes to fit the target body shape and pose without considering inter-cloth interaction. Lastly, the untangling network predicts the per-vertex displacements in a way that resolves interpenetration between clothes. In experiments, the proposed model demonstrates strong performance in complex multi-layered scenarios. Being agnostic to cloth topology, our method can be readily used for layered virtual try-on of real clothes in diverse poses and combinations of clothes.

Computer Vision and Pattern Recognition,Graphics

What problem does this paper attempt to address?

The paper attempts to address the challenges faced when draping multiple layers of clothing on a 3D human model, particularly the problem of modeling interactions between different layers of clothing. Existing learning-based methods have shown good results when draping a single piece of clothing, but still face difficulties when dealing with multiple layers of clothing because the interactions between the clothes are hard to model. To solve this problem, the authors propose a new method called ClothCombo, which uses Graph Neural Networks (GNN) to efficiently simulate the interactions between different layers of clothing, thereby achieving the draping of multiple layers of clothing. Specifically, the method first creates feature embeddings for each piece of clothing using a topology-independent network, then fits all the clothes to the target human shape and pose through a deformation network, and finally predicts the displacement of each vertex through an untangling network to solve the penetration problem between clothes. This method can be applied to complex multi-layer scenarios and has good generality for clothes with different topological structures.