Abstract:Popular fashion e-commerce platforms mostly provide details about low-level attributes of an apparel (for example, neck type, dress length, collar type, print etc) on their product detail pages. However, customers usually prefer to buy apparel based on their style information, or simply put, occasion (for example, party wear, sports wear, casual wear etc). Application of a supervised image-captioning model to generate style-based image captions is limited because obtaining ground-truth annotations in the form of style-based captions is difficult. This is because annotating style-based captions requires a certain amount of fashion domain expertise, and also adds to the costs and manual effort. On the contrary, low-level attribute based annotations are much more easily available. To address this issue, we propose a transfer-learning based image captioning model that is trained on a source dataset with sufficient attribute-based ground-truth captions, and used to predict style-based captions on a target dataset. The target dataset has only a limited amount of images with style-based ground-truth captions. The main motivation of our approach comes from the fact that most often there are correlations among the low-level attributes and the higher-level styles for an apparel. We leverage this fact and train our model in an encoder-decoder based framework using attention mechanism. In particular, the encoder of the model is first trained on the source dataset to obtain latent representations capturing the low-level attributes. The trained model is fine-tuned to generate style-based captions for the target dataset. To highlight the effectiveness of our method, we qualitatively and quantitatively demonstrate that the captions generated by our approach are close to the actual style information for the evaluated apparel. A Proof Of Concept (POC) for our model is under pilot at Myntra (www.myntra.com) where it is exposed to some internal users for feedback.

Leveraging Weakly Annotated Data for Fashion Image Retrieval and Label Prediction

Fine-grained Apparel Classification and Retrieval without rich annotations

A deep learning system for predicting size and fit in fashion e-commerce

Attr2Style: A Transfer Learning Approach for Inferring Fashion Styles via Apparel Attributes

Multi-Modal and Multi-Domain Embedding Learning for Fashion Retrieval and Analysis

Data Efficient Training with Imbalanced Label Sample Distribution for Fashion Detection

Weakly Supervised High-Fidelity Clothing Model Generation

Interpretable Multimodal Retrieval for Fashion Products.

A knowledge-sharing semi-supervised approach for fashion clothes classification and attribute prediction

Towards Better Understanding the Clothing Fashion Styles: A Multimodal Deep Learning Approach

A Deep-Learning-Based Fashion Attributes Detection Model

Large-Scale Product Retrieval with Weakly Supervised Representation Learning

Deep Learning for Demand Forecasting in the Fashion and Apparel Retail Industry

Neural Networks for Fashion Image Classification and Visual Search

A Fine-Grained Vision and Language Representation Framework with Graph-Based Fashion Semantic Knowledge

MMFL-Net: Multi-scale and Multi-granularity Feature Learning for Cross-domain Fashion Retrieval

Learning To Appreciate The Aesthetic Effects Of Clothing

Large Scale Visual Recommendations From Street Fashion Images

FashionSearchNet-v2: Learning Attribute Representations with Localization for Image Retrieval with Attribute Manipulation

Personalized Clothing Prediction Algorithm Based on Multi-modal Feature Fusion

Learning Visual Clothing Style with Heterogeneous Dyadic Co-occurrences