Abstract:The ability to correctly classify and retrieve apparel images has a variety of applications important to e-commerce, online advertising and internet search. In this work, we propose a robust framework for fine-grained apparel classification, in-shop and cross-domain retrieval which eliminates the requirement of rich annotations like bounding boxes and human-joints or clothing landmarks, and training of bounding box/ key-landmark detector for the same. Factors such as subtle appearance differences, variations in human poses, different shooting angles, apparel deformations, and self-occlusion add to the challenges in classification and retrieval of apparel items. Cross-domain retrieval is even harder due to the presence of large variation between online shopping images, usually taken in ideal lighting, pose, positive angle and clean background as compared with street photos captured by users in complicated conditions with poor lighting and cluttered scenes. Our framework uses compact bilinear CNN with tensor sketch algorithm to generate embeddings that capture local pairwise feature interactions in a translationally invariant manner. For apparel classification, we pass the feature embeddings through a softmax classifier, while, the in-shop and cross-domain retrieval pipelines use a triplet-loss based optimization approach, such that squared Euclidean distance between embeddings measures the dissimilarity between the images. Unlike previous works that relied on bounding box, key clothing landmarks or human joint detectors to assist the final deep classifier, proposed framework can be trained directly on the provided category labels or generated triplets for triplet loss optimization. Lastly, Experimental results on the DeepFashion fine-grained categorization, and in-shop and consumer-to-shop retrieval datasets provide a comparative analysis with previous work performed in the domain.

IndoFashion : Apparel Classification for Indian Ethnic Clothes

A Federated Approach for Fine-Grained Classification of Fashion Apparel

Fine-grained Apparel Classification and Retrieval without rich annotations

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images

Cloth Pattern Recognition Using Machine Learning and Neural Network

Relatable Clothing: Detecting Visual Relationships between People and Clothing

BigFashion: A Large-Scale Dataset for Fine-Grained Attributes Recognition

The Imaterialist Fashion Attribute Dataset.

PoshakNet: Framework for matching dresses from real-life photos using GAN and Siamese Network

Indian Masked Faces in the Wild Dataset

FashionAI: A Hierarchical Dataset for Fashion Understanding

CLOTH3D: Clothed 3D Humans

Dress-Me-Up: A Dataset & Method for Self-Supervised 3D Garment Retargeting

Content-based image retrieval of Indian traditional textile motifs using deep feature fusion

Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms

ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment

Segmentation task for fashion and apparel

Sareenet: saree texture classification via region-based patch generation with an optimized efficient Aquila network

DeepEthnic: Multi-Label Ethnic Classification from Face Images

Searching for Apparel Products from Images in the Wild

InFER: A Multi-Ethnic Indian Facial Expression Recognition Dataset