Abstract:Fashion Compatibility Modeling (FCM), which aims to automatically evaluate whether a given set of fashion items makes a compatible outfit, has attracted increasing research attention. Recent studies have demonstrated the benefits of conducting the item representation disentanglement towards FCM. Although these efforts have achieved prominent progress, they still perform unsatisfactorily, as they mainly investigate the visual content of fashion items, while overlooking the semantic attributes of items (e.g., color and pattern), which could largely boost the model performance and interpretability. To address this issue, we propose to comprehensively explore the visual content and attributes of fashion items towards FCM. This problem is non-trivial considering the following challenges: a) how to utilize the irregular attribute labels of items to partially supervise the attribute-level representation learning of fashion items; b) how to ensure the intact disentanglement of attribute-level representations; and c) how to effectively sew the multiple granulairites (i.e, coarse-grained item-level and fine-grained attribute-level) information to enable performance improvement and interpretability. To address these challenges, in this work, we present a partially supervised outfit compatibility modeling scheme (PS-OCM). In particular, we first devise a partially supervised attribute-level embedding learning component to disentangle the fine-grained attribute embeddings from the entire visual feature of each item. We then introduce a disentangled completeness regularizer to prevent the information loss during disentanglement. Thereafter, we design a hierarchical graph convolutional network, which seamlessly integrates the attribute- and item-level compatibility modeling, and enables the explainable compatibility reasoning. Extensive experiments on the real-world dataset demonstrate that our PS-OCM significantly outperforms the state-of-the-art baselines. We have released our source codes and well-trained models to benefit other researchers (https://site2750.wixsite.com/ps-ocm).

Low-Rank Regularized Multi-Representation Learning for Fashion Compatibility Prediction.

Tripartite Graph Regularized Latent Low-Rank Representation for Fashion Compatibility Prediction

Fashion Recommendation on Street Images.

Unifying Heterogeneous and Homogeneous Relations for Personalized Compatibility Modeling

Outfit compatibility prediction with multi-layered feature fusion network

Learning Fashion Compatibility with Bidirectional LSTMs

Consistency Regularization for Complementary Clothing Recommendations

Learning Outfit Compatibility with Graph Attention Network and Visual-Semantic Embedding.

Outfit Compatibility Prediction and Diagnosis with Multi-Layered Comparison Network

Learning Fashion Compatibility from In-the-wild Images

Fashion Recommendation and Compatibility Prediction Using Relational Network

Decoding Style: Efficient Fine-Tuning of LLMs for Image-Guided Outfit Recommendation with Preference

NeuroStylist: Neural Compatibility Modeling for Clothing Matching.

Research on type-aware fashion compatibility prediction based on a hybrid attention mechanism

Multi-order Attributes Information Fusion Via Hypergraph Matching for Popular Fashion Compatibility Analysis

Fashion Compatibility Modeling through a Multi-modal Try-on-guided Scheme

Multimodal High-Order Relationship Inference Network for Fashion Compatibility Modeling in Internet of Multimedia Things

Outfit compatibility model using fully connected self-adjusting graph neural network

An End-to-End Attention-Based Neural Model for Complementary Clothing Matching

Partially Supervised Compatibility Modeling

Learning Attribute and Class-Specific Representation Duet for Fine-Grained Fashion Analysis