Abstract:Reconstructing garments from monocular videos has attracted considerable attention as it provides a convenient and low-cost solution for clothing digitization. In reality, people wear clothing with countless variations and multiple layers. Existing studies attempt to extract garments from a single video. They either behave poorly in generalization due to reliance on limited clothing templates or struggle to handle the intersections of multi-layered clothing leading to the lack of physical plausibility. Besides, there are inevitable and undetectable overlaps for a single video that hinder researchers from modeling complete and intersection-free multi-layered clothing. To address the above limitations, in this paper, we propose a novel method to reconstruct multi-layered clothing from multiple monocular videos sequentially, which surpasses existing work in generalization and robustness against penetration. For each video, neural fields are employed to implicitly represent the clothed body, from which the meshes with frame-consistent structures are explicitly extracted. Next, we implement a template-free method for extracting a single garment by back-projecting the image segmentation labels of different frames onto these meshes. In this way, multiple garments can be obtained from these monocular videos and then aligned to form the whole outfit. However, intersection always occurs due to overlapping deformation in the real world and perceptual errors in monocular videos. To this end, we innovatively introduce a physics-aware module that combines neural fields with a position-based simulation framework to fine-tune the penetrating vertices of garments, ensuring robustly intersection-free. Additionally, we collect a mini dataset with fashionable garments to evaluate the quality of clothing reconstruction comprehensively. We release our code and data at https://github.com/SMY19999/IF-Garments.

Real-time Clothing Detection Networks for Surveillance Videos

Deforming Garment Classification with Shallow Temporal Extraction and Tree-Based Fusion

Transferring Clothing Parsing From Fashion Dataset To Surveillance

Transferring Fashion to Surveillance with Weak Labels.

Two-Stream Multi-Task Network for Fashion Recognition

Clothing color recognition based on multi-scale illumination estimation and hierarchical categorization

Clothescounter: A Framework for Star-Oriented Clothes Mining from Videos

Texture and Shape Biased Two-Stream Networks for Clothing Classification and Attribute Recognition

Clothing recognition based on deep sparse convolutional neural network

Dress Code Monitoring Method in Industrial Scene Based on Improved YOLOv8n and DeepSORT

Human-Centric Clothing Segmentation via Deformable Semantic Locality-Preserving Network

IF-Garments: Reconstructing Your Intersection-Free Multi-Layered Garments from Monocular Videos

A Fine-grained Attributes Recognition Model for Clothing Based on Improved the CSPDarknet and PAFPN Network

Multi-keypoints matching network for clothing detection

DeepMark++: Real-time Clothing Detection at the Edge

Attention-Aware Network with Latent Semantic Analysis for Clothing Invariant Gait Recognition

Task-Aware Attention Model for Clothing Attribute Prediction

BigFashion: A Large-Scale Dataset for Fine-Grained Attributes Recognition

Multi-Task Curriculum Transfer Deep Learning of Clothing Attributes

Improving Deep Convolutional Neural Networks For Real-World Clothing Image

FFENet: Frequency-Spatial Feature Enhancement Network for Clothing Classification