Abstract:In most E-commerce platforms, whether the displayed items trigger the user’s interest largely depends on their most eye-catching multimodal content. Consequently, increasing efforts focus on modeling multimodal user preference, and the pressing paradigm is to incorporate complete multimodal deep features of the items into the recommendation module. However, the existing studies ignore the mismatch problem between multimodal feature extraction (MFE) and user interest modeling (UIM) . That is, MFE and UIM have different emphases. Specifically, MFE is migrated from and adapted to upstream tasks such as image classification. In addition, it is mainly a content-oriented and non-personalized process, while UIM, with its greater focus on understanding user interaction, is essentially a user-oriented and personalized process. Therefore, the direct incorporation of MFE into UIM for purely user-oriented tasks, tends to introduce a large number of preference-independent multimodal noise and contaminate the embedding representations in UIM. This paper aims at solving the mismatch problem between MFE and UIM, so as to generate high-quality embedding representations and better model multimodal user preferences. Towards this end, we develop a novel model, m ultimodal e ntity g raph c ollaborative f iltering, short for MEGCF. The UIM of the proposed model captures the semantic correlation between interactions and the features obtained from MFE, thus making a better match between MFE and UIM. More precisely, semantic-rich entities are first extracted from the multimodal data, since they are more relevant to user preferences than other multimodal information. These entities are then integrated into the user-item interaction graph. Afterwards, a symmetric linear Graph Convolution Network (GCN) module is constructed to perform message propagation over the graph, in order to capture both high-order semantic correlation and collaborative filtering signals. Finally, the sentiment information from the review data are used to fine-grainedly weight neighbor aggregation in the GCN, as it reflects the overall quality of the items, and therefore it is an important modality information related to user preferences. Extensive experiments demonstrate the effectiveness and rationality of MEGCF. 1

Multimodal collaborative graph for image recommendation

Contrastive Intra- and Inter-Modality Generation for Enhancing Incomplete Multimedia Recommendation

Multimodal Graph Contrastive Learning for Multimedia-Based Recommendation

Multi-modal Recommendation Based on Knowledge Graph

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

MMGCN: Multi-modal Graph Convolution Network for Personalized Recommendation of Micro-video

MGAT: Multimodal Graph Attention Network for Recommendation.

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

A multimedia recommendation model based on collaborative graph

Multi-View Graph Convolutional Network for Multimedia Recommendation

Multi-Behavior Enhanced Heterogeneous Graph Convolutional Networks Recommendation Algorithm based on Feature-Interaction

Learning Hybrid Behavior Patterns for Multimedia Recommendation

MM-GEF: Multi-modal representation meet collaborative filtering

GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal Recommendation

Graph Neural Networks with Deep Mutual Learning for Designing Multi-modal Recommendation Systems

Graph Heterogeneous Multi-Relational Recommendation

M 3 KGR: A Momentum Contrastive Multi-Modal Knowledge Graph Learning Framework for Recommendation

Multimodal association mining for personalized image browsing

Preference-corrected multimodal graph convolutional recommendation network

Multi-Component Graph Convolutional Collaborative Filtering

Hierarchical User Intent Graph Network forMultimedia Recommendation