Outfit compatibility model using fully connected self-adjusting graph neural network

Hong Liu,Li Li,Neng Yu,Kai Ma,Tao Peng,Xinrong Hu
DOI: https://doi.org/10.1007/s00371-023-03238-6
IF: 2.835
2024-01-23
The Visual Computer
Abstract:Outfit compatibility modeling is an increasingly important task that has garnered much attention from researchers, and graph neural network (GNN)-based methods have become the mainstream approach to address this task. Despite significant progress achieved by existing research, most of them have overlooked the importance of low-order connectivity in graph data and the relationship between individual fashion items and overall outfit style. To address this issue, we propose an outfit compatibility modeling scheme based on outfit-level relationships. This scheme consists of two key components: FCSA-GNN and GOR. The former consists of multiple layers of Fashion Items Relationship Propagation, where the weights of the graph edges are adapted based on the Category Co-occurrence Matrix. This approach avoids potential imbalances in the quantities of different fashion item categories within the dataset. Subsequently, by connecting the outputs of GNN at each layer, it explores the relationships between fashion item visual signals at different levels. The latter integrates the overall outfits style and further enhances the model's ability to learn a comprehensive representation of the overall outfits through the proposed outfit-level relationships. Experimental results on two real datasets, Polyvore outfit-ND and Polyvore outfit-D, demonstrate that our method outperforms existing state-of-the-art methods when considering only visual information.
computer science, software engineering
What problem does this paper attempt to address?