Abstract:In most E-commerce platforms, whether the displayed items trigger the user’s interest largely depends on their most eye-catching multimodal content. Consequently, increasing efforts focus on modeling multimodal user preference, and the pressing paradigm is to incorporate complete multimodal deep features of the items into the recommendation module. However, the existing studies ignore the mismatch problem between multimodal feature extraction (MFE) and user interest modeling (UIM) . That is, MFE and UIM have different emphases. Specifically, MFE is migrated from and adapted to upstream tasks such as image classification. In addition, it is mainly a content-oriented and non-personalized process, while UIM, with its greater focus on understanding user interaction, is essentially a user-oriented and personalized process. Therefore, the direct incorporation of MFE into UIM for purely user-oriented tasks, tends to introduce a large number of preference-independent multimodal noise and contaminate the embedding representations in UIM. This paper aims at solving the mismatch problem between MFE and UIM, so as to generate high-quality embedding representations and better model multimodal user preferences. Towards this end, we develop a novel model, m ultimodal e ntity g raph c ollaborative f iltering, short for MEGCF. The UIM of the proposed model captures the semantic correlation between interactions and the features obtained from MFE, thus making a better match between MFE and UIM. More precisely, semantic-rich entities are first extracted from the multimodal data, since they are more relevant to user preferences than other multimodal information. These entities are then integrated into the user-item interaction graph. Afterwards, a symmetric linear Graph Convolution Network (GCN) module is constructed to perform message propagation over the graph, in order to capture both high-order semantic correlation and collaborative filtering signals. Finally, the sentiment information from the review data are used to fine-grainedly weight neighbor aggregation in the GCN, as it reflects the overall quality of the items, and therefore it is an important modality information related to user preferences. Extensive experiments demonstrate the effectiveness and rationality of MEGCF. 1

An Expert Collaborative Filtering Algorithm Integrating Multimodal Information

Hybrid Gaussian pLSA model and item based collaborative filtering recommendation

Improving Recommendations With Collaborative Factors

A User-based and Item-based Collaborative Filtering Recommendation Algorithm

A Hybrid Recommendation Algorithm Based on Clustering and Collaborative Filtering

Confidence-Learning Based Collaborative Filtering With Heterogeneous Implicit Feedbacks

Collaborative Filtering Recommendation Algorithm Based on Selective Prediction Strategy

Information Filtering Via Collaborative User Clustering Modeling.

Deep Collaborative Filtering Incorporating Auxiliary Multi-Media Information.

Multi-linear Interactive Matrix Factorization.

Fusion Recommendation Algorithm Based on DeepWalk and Item-Based Collaborative Filtering

Incorporating Community Detection and Clustering Techniques into Collaborative Filtering Model

A Dynamic Collaborative Filtering Algorithm based on Convolutional Neural Networks and Multi-layer Perceptron

Multimodal Movie Recommendation System Using Deep Learning

Multimodal Sparse Linear Integration for Content-Based Item Recommendation

Multi-Task Matrix Factorization For Collaborative Filtering

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

Multi-modal recommendation algorithm fusing visual and textual features

Personalized Recommendation Based on Reviews and Ratings Alleviating the Sparsity Problem of Collaborative Filtering

A New Collaborative Filtering Algorithm Based on Data Smoothing

An Improved Collaborative Filtering Algorithm based on Dimension Reduction and Improved Clustering