GAPS: Geometry-Aware, Physics-Based, Self-Supervised Neural Garment Draping

Ruochen Chen,Liming Chen,Shaifali Parashar

2024-03-15

Abstract:Recent neural, physics-based modeling of garment deformations allows faster and visually aesthetic results as opposed to the existing methods. Material-specific parameters are used by the formulation to control the garment inextensibility. This delivers unrealistic results with physically implausible stretching. Oftentimes, the draped garment is pushed inside the body which is either corrected by an expensive post-processing, thus adding to further inconsistent stretching; or by deploying a separate training regime for each body type, restricting its scalability. Additionally, the flawed skinning process deployed by existing methods produces incorrect results on loose garments. In this paper, we introduce a geometrical constraint to the existing formulation that is collision-aware and imposes garment inextensibility wherever possible. Thus, we obtain realistic results where draped clothes stretch only while covering bigger body regions. Furthermore, we propose a geometry-aware garment skinning method by defining a body-garment closeness measure which works for all garment types, especially the loose ones.

Computer Vision and Pattern Recognition,Graphics,Machine Learning

What problem does this paper attempt to address?

The main problems that this paper attempts to solve are the unrealistic stretching and body - garment collision problems existing in the existing neural network methods when simulating garment deformation. Specifically:

1. **Unrealistic stretching**: Existing methods often introduce unnatural stretching when preventing garment - body collisions, resulting in garment deformation that does not conform to physical laws.
2. **Body - garment collision**: Current methods require additional post - processing steps or restrictive training strategies when dealing with collisions between garments and bodies, which not only increase computational complexity but also affect real - time performance and the consistency of results.
3. **Skin binding problem**: Existing methods have flaws in the skin binding process when dealing with loose garments, leading to inaccurate results.

To overcome these problems, the paper proposes GAPS (Geometry - Aware, Physics - Based, Self - Supervised Neural Garment Draping), a self - supervised neural network method that combines geometric constraints and physical principles. The main contributions of GAPS include:

1. **Geometry - aware deformation modeling**: By applying rigid constraints in the local area of each vertex, it is ensured that the garment remains non - stretchable in most cases and only allows moderate stretching when covering a large body area.
2. **Geometry - aware skin binding**: A skin binding method based on the Gaussian radial basis function (RBF) is proposed, which can handle different types of garments, especially loose garments, more accurately.
3. **Self - supervised learning framework**: A self - supervised learning method is used, which avoids relying on a large amount of high - quality 3D data and at the same time improves the generalization ability of the model.

Through these innovations, GAPS can generate more realistic and natural garment deformation effects while maintaining real - time performance.