Abstract:In most E-commerce platforms, whether the displayed items trigger the user’s interest largely depends on their most eye-catching multimodal content. Consequently, increasing efforts focus on modeling multimodal user preference, and the pressing paradigm is to incorporate complete multimodal deep features of the items into the recommendation module. However, the existing studies ignore the mismatch problem between multimodal feature extraction (MFE) and user interest modeling (UIM) . That is, MFE and UIM have different emphases. Specifically, MFE is migrated from and adapted to upstream tasks such as image classification. In addition, it is mainly a content-oriented and non-personalized process, while UIM, with its greater focus on understanding user interaction, is essentially a user-oriented and personalized process. Therefore, the direct incorporation of MFE into UIM for purely user-oriented tasks, tends to introduce a large number of preference-independent multimodal noise and contaminate the embedding representations in UIM. This paper aims at solving the mismatch problem between MFE and UIM, so as to generate high-quality embedding representations and better model multimodal user preferences. Towards this end, we develop a novel model, m ultimodal e ntity g raph c ollaborative f iltering, short for MEGCF. The UIM of the proposed model captures the semantic correlation between interactions and the features obtained from MFE, thus making a better match between MFE and UIM. More precisely, semantic-rich entities are first extracted from the multimodal data, since they are more relevant to user preferences than other multimodal information. These entities are then integrated into the user-item interaction graph. Afterwards, a symmetric linear Graph Convolution Network (GCN) module is constructed to perform message propagation over the graph, in order to capture both high-order semantic correlation and collaborative filtering signals. Finally, the sentiment information from the review data are used to fine-grainedly weight neighbor aggregation in the GCN, as it reflects the overall quality of the items, and therefore it is an important modality information related to user preferences. Extensive experiments demonstrate the effectiveness and rationality of MEGCF. 1

Deep Collaborative Filtering Incorporating Auxiliary Multi-Media Information.

Improving Recommendations With Collaborative Factors

Information Filtering Via Collaborative User Clustering Modeling.

Binary Collaborative Filtering Ensemble

Multi-Task Matrix Factorization For Collaborative Filtering

Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention

Transfer Meets Hybrid: A Synthetic Approach for Cross-Domain Collaborative Filtering with Text

Fusion Recommendation Algorithm Based on DeepWalk and Item-Based Collaborative Filtering

Multi-Domain Collaborative Filtering

Cross-Domain Deep Collaborative Filtering for Recommendation.

Smoothing based approach for hybrid collaborative filtering

A Dynamic Collaborative Filtering Algorithm based on Convolutional Neural Networks and Multi-layer Perceptron

A Probabilistic Semantic Based Mixture Collaborative Filtering

Collaborative Filtering with Topic and Social Latent Factors Incorporating Implicit Feedback

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

Incremental Learning for Dynamic Collaborative Filtering.

Dual Channel Hypergraph Collaborative Filtering

Deep Item-based Collaborative Filtering for Top-N Recommendation

Deep Social Collaborative Filtering

A Collaborative Filtering-Based Recommender Systems approach for Multifarious applications

Attribute-based Neural Collaborative Filtering