ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment

Bingyang Zhou,Haoyu Zhou,Tianhai Liang,Qiaojun Yu,Siheng Zhao,Yuwei Zeng,Jun Lv,Siyuan Luo,Qiancai Wang,Xinyuan Yu,Haonan Chen,Cewu Lu,Lin Shao
2023-08-19
Abstract:We present ClothesNet: a large-scale dataset of 3D clothes objects with information-rich annotations. Our dataset consists of around 4400 models covering 11 categories annotated with clothes features, boundary lines, and keypoints. ClothesNet can be used to facilitate a variety of computer vision and robot interaction tasks. Using our dataset, we establish benchmark tasks for clothes perception, including classification, boundary line segmentation, and keypoint detection, and develop simulated clothes environments for robotic interaction tasks, including rearranging, folding, hanging, and dressing. We also demonstrate the efficacy of our ClothesNet in real-world experiments. Supplemental materials and dataset are available on our project webpage.
Robotics,Artificial Intelligence,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in robot vision and manipulation tasks, especially those related to clothing (such as folding, tidying, hanging, dressing, etc.), there is a lack of large - scale, high - quality, and information - rich 3D clothing model datasets. Existing 3D clothing datasets are either small in scale, or not suitable for tasks requiring large deformations in the simulation environment, or lack detailed annotation information. These problems limit the improvement of the autonomous performance of robots in clothing - handling tasks, especially in the case of high - dimensional state representation and complex dynamics. It is both expensive and unsafe to train robots directly in real - world scenarios. To this end, the paper introduces **ClothesNet**: a large - scale dataset containing approximately 4,400 3D clothing models, covering 11 categories, and annotated with clothing features, boundary lines, and key points. These models can be used to promote various computer vision and robot - interaction tasks, such as classification, boundary line segmentation, key point detection, etc. In addition, based on ClothesNet, the authors also developed a simulated clothing environment to support robots in learning clothing - handling skills in a virtual environment, thereby laying the foundation for practical applications. By establishing this dataset and the corresponding simulated environment, the paper aims to provide a platform that enables researchers to develop and test new algorithms and techniques more effectively to improve the performance of robots in clothing - handling tasks. This not only helps to promote the development of robotics technology but also has important significance for automated services in daily life.