Abstract:Graph neural networks (GNNs) have shown great potential for personalized recommendation. At the core is to reorganize interaction data as a user-item bipartite graph and exploit high-order connectivity among user and item nodes to enrich their representations. While achieving great success, most existing works consider interaction graph based only on ID information, foregoing item contents from multiple modalities (e.g., visual, acoustic, and textual features of micro-video items). Distinguishing personal interests on different modalities at a granular level was not explored until recently proposed MMGCN (Wei et al., 2019). However, it simply employs GNNs on parallel interaction graphs and treats information propagated from all neighbors equally, failing to capture user preference adaptively. Hence, the obtained representations might preserve redundant, even noisy information, leading to non-robustness and suboptimal performance. In this work, we aim to investigate how to adopt GNNs on multimodal interaction graphs, to adaptively capture user preference on different modalities and offer in-depth analysis on why an item is suitable to a user. Towards this end, we propose a new Multimodal Graph Attention Network, short for MGAT, which disentangles personal interests at the granularity of modality. In particular, built upon multimodal interaction graphs, MGAT conducts information propagation within individual graphs, while leveraging the gated attention mechanism to identify varying importance scores of different modalities to user preference. As such, it is able to capture more complex interaction patterns hidden in user behaviors and provide a more accurate recommendation. Empirical results on two micro-video recommendation datasets, Tiktok and MovieLens, show that MGAT exhibits substantial improvements over the state-of-the-art baselines like NGCF (Wang, He, et al., 2019) and MMGCN (Wei et al., 2019). Further analysis on a case study illustrates how MGAT generates attentive information flow over multimodal interaction graphs.

User-Video Co-Attention Network for Personalized Micro-video Recommendation

Personalized Micro-Video Recommendation via Hierarchical User Interest Modeling

MMGCN: Multi-modal Graph Convolution Network for Personalized Recommendation of Micro-video

Learning and Fusing Multiple User Interest Representations for Micro-Video and Movie Recommendations

Personalized Micro-video Recommendation Based on Multi-modal Features and User Interest Evolution

Heterogeneous Hierarchical Feature Aggregation Network for Personalized Micro-Video Recommendation

Temporal Hierarchical Attention at Category- and Item-Level for Micro-Video Click-Through Prediction.

Attention-based Multimodal Feature Representation Model for Micro-video Recommendation

MMM: Multi-source Multi-net Micro-video Recommendation with Clustered Hidden Item Representation Learning

Modeling High-order Interactions Across Multi-interests for Micro-video Reommendation (student Abstract)

Implicit semantic-based personalized micro-videos recommendation

Context-aware focal alignment network for micro-video multi-label classification

Learning Fine-grained User Interests for Micro-video Recommendation

Temporal Diversity-Aware Micro-Video Recommendation with Long- and Short-Term Interests Modeling

DualGNN: Dual Graph Neural Network for Multimedia Recommendation

Personalized Hashtag Recommendation for Micro-videos

CMBPR: Category-Aided Multi-Channel Bayesian Personalized Ranking for Short Video Recommendation

MGAT: Multimodal Graph Attention Network for Recommendation.

A Unified Personalized Video Recommendation via Dynamic Recurrent Neural Networks.