Abstract:Fashion Compatibility Modeling (FCM), which aims to automatically evaluate whether a given set of fashion items makes a compatible outfit, has attracted increasing research attention. Recent studies have demonstrated the benefits of conducting the item representation disentanglement towards FCM. Although these efforts have achieved prominent progress, they still perform unsatisfactorily, as they mainly investigate the visual content of fashion items, while overlooking the semantic attributes of items (e.g., color and pattern), which could largely boost the model performance and interpretability. To address this issue, we propose to comprehensively explore the visual content and attributes of fashion items towards FCM. This problem is non-trivial considering the following challenges: a) how to utilize the irregular attribute labels of items to partially supervise the attribute-level representation learning of fashion items; b) how to ensure the intact disentanglement of attribute-level representations; and c) how to effectively sew the multiple granulairites (i.e, coarse-grained item-level and fine-grained attribute-level) information to enable performance improvement and interpretability. To address these challenges, in this work, we present a partially supervised outfit compatibility modeling scheme (PS-OCM). In particular, we first devise a partially supervised attribute-level embedding learning component to disentangle the fine-grained attribute embeddings from the entire visual feature of each item. We then introduce a disentangled completeness regularizer to prevent the information loss during disentanglement. Thereafter, we design a hierarchical graph convolutional network, which seamlessly integrates the attribute- and item-level compatibility modeling, and enables the explainable compatibility reasoning. Extensive experiments on the real-world dataset demonstrate that our PS-OCM significantly outperforms the state-of-the-art baselines. We have released our source codes and well-trained models to benefit other researchers (https://site2750.wixsite.com/ps-ocm).

Hierarchical Multimodal Graph Learning for Outfit Compatibility Modelling

Modality-Oriented Graph Learning Toward Outfit Compatibility Modeling

Heterogeneous-Grained Multi-Modal Graph Network for Outfit Recommendation

Outfit compatibility model using fully connected self-adjusting graph neural network

Multimodal Compatibility Modeling Via Exploring the Consistent and Complementary Correlations.

Partially Supervised Compatibility Modeling

Learning Outfit Compatibility with Graph Attention Network and Visual-Semantic Embedding.

Complementary Factorization Towards Outfit Compatibility Modeling

Learning Visual Clothing Style with Heterogeneous Dyadic Co-occurrences

Heterogeneous Graph Learning for Personalized OCM

Hierarchical Fashion Graph Network for Personalized Outfit Recommendation

Category-Aware Multimodal Attention Network for Fashion Compatibility Modeling

Personalized Fashion Compatibility Modeling Via Metapath-guided Heterogeneous Graph Learning

Outfit Compatibility Prediction and Diagnosis with Multi-Layered Comparison Network

Learning compatibility knowledge for outfit recommendation with complementary clothing matching

Unifying Heterogeneous and Homogeneous Relations for Personalized Compatibility Modeling

Learning Fashion Compatibility with Context Conditioning Embedding

Fashion Compatibility Modeling through a Multi-modal Try-on-guided Scheme

Modeling Multi-Relational Connectivity for Personalized Fashion Matching

Learning Fashion Compatibility with Bidirectional LSTMs

Learning Tuple Compatibility for Conditional OutfitRecommendation