Abstract:Reconstructing garments from monocular videos has attracted considerable attention as it provides a convenient and low-cost solution for clothing digitization. In reality, people wear clothing with countless variations and multiple layers. Existing studies attempt to extract garments from a single video. They either behave poorly in generalization due to reliance on limited clothing templates or struggle to handle the intersections of multi-layered clothing leading to the lack of physical plausibility. Besides, there are inevitable and undetectable overlaps for a single video that hinder researchers from modeling complete and intersection-free multi-layered clothing. To address the above limitations, in this paper, we propose a novel method to reconstruct multi-layered clothing from multiple monocular videos sequentially, which surpasses existing work in generalization and robustness against penetration. For each video, neural fields are employed to implicitly represent the clothed body, from which the meshes with frame-consistent structures are explicitly extracted. Next, we implement a template-free method for extracting a single garment by back-projecting the image segmentation labels of different frames onto these meshes. In this way, multiple garments can be obtained from these monocular videos and then aligned to form the whole outfit. However, intersection always occurs due to overlapping deformation in the real world and perceptual errors in monocular videos. To this end, we innovatively introduce a physics-aware module that combines neural fields with a position-based simulation framework to fine-tune the penetrating vertices of garments, ensuring robustly intersection-free. Additionally, we collect a mini dataset with fashionable garments to evaluate the quality of clothing reconstruction comprehensively. We release our code and data at https://github.com/SMY19999/IF-Garments.

Deforming Garment Classification with Shallow Temporal Extraction and Tree-Based Fusion

Continuous Perception Garment Classification Based on Optical Flow Variation.

Clothes Grasping and Unfolding Based on RGB-D Semantic Segmentation

MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video

A Part-Based and Feature Fusion Method for Clothing Classification.

Improving Apparel Detection with Category Grouping and Multi-grained Branches

DeepCloth: Neural Garment Representation for Shape and Style Editing

Detail-aware Deep Clothing Animations Infused with Multi-source Attributes

Feature fusion network for clothing parsing

A Continuous Robot Vision Approach for Predicting Shapes and Visually Perceived Weights of Garments

Texture and Shape Biased Two-Stream Networks for Clothing Classification and Attribute Recognition

Fine-grained Apparel Classification and Retrieval without rich annotations

An End-to-End Framework for Clothing Collocation Based on Semantic Feature Fusion

Multideep Feature Fusion Algorithm for Clothing Style Recognition

A Federated Approach for Fine-Grained Classification of Fashion Apparel

High-Accuracy Clothing and Style Classification Via Multi-Feature Fusion

ClothSeg: semantic segmentation network with feature projection for clothing parsing

Garment4D: Garment Reconstruction from Point Cloud Sequences

TSFCloNet: Clothing Classification Algorithm Based on Two-Stream Network Structure

GarmentTracking: Category-Level Garment Pose Tracking

IF-Garments: Reconstructing Your Intersection-Free Multi-Layered Garments from Monocular Videos