Abstract:Graph neural networks (GNNs) have shown great potential for personalized recommendation. At the core is to reorganize interaction data as a user-item bipartite graph and exploit high-order connectivity among user and item nodes to enrich their representations. While achieving great success, most existing works consider interaction graph based only on ID information, foregoing item contents from multiple modalities (e.g., visual, acoustic, and textual features of micro-video items). Distinguishing personal interests on different modalities at a granular level was not explored until recently proposed MMGCN (Wei et al., 2019). However, it simply employs GNNs on parallel interaction graphs and treats information propagated from all neighbors equally, failing to capture user preference adaptively. Hence, the obtained representations might preserve redundant, even noisy information, leading to non-robustness and suboptimal performance. In this work, we aim to investigate how to adopt GNNs on multimodal interaction graphs, to adaptively capture user preference on different modalities and offer in-depth analysis on why an item is suitable to a user. Towards this end, we propose a new Multimodal Graph Attention Network, short for MGAT, which disentangles personal interests at the granularity of modality. In particular, built upon multimodal interaction graphs, MGAT conducts information propagation within individual graphs, while leveraging the gated attention mechanism to identify varying importance scores of different modalities to user preference. As such, it is able to capture more complex interaction patterns hidden in user behaviors and provide a more accurate recommendation. Empirical results on two micro-video recommendation datasets, Tiktok and MovieLens, show that MGAT exhibits substantial improvements over the state-of-the-art baselines like NGCF (Wang, He, et al., 2019) and MMGCN (Wei et al., 2019). Further analysis on a case study illustrates how MGAT generates attentive information flow over multimodal interaction graphs.

SHG: Self-Supervised Hypergraph Gate Networks for Enhanced Multi-Modal Representation

Self-Supervised Hypergraph Learning for Enhanced Multimodal Representation

HGNN$^+$: General Hypergraph Neural Networks

Self-supervised Graph Representations with Generative Adversarial Learning

Residual Enhanced Multi-Hypergraph Neural Network

MGAT: Multimodal Graph Attention Network for Recommendation.

HybridGNN: Learning Hybrid Representation in Multiplex Heterogeneous Networks

UniG-Encoder: A Universal Feature Encoder for Graph and Hypergraph Node Classification

HGBER: Heterogeneous Graph Neural Network With Bidirectional Encoding Representation

SHGNN: Structure-Aware Heterogeneous Graph Neural Network

Ada-HGNN: Adaptive Sampling for Scalable Hypergraph Neural Networks

Graph Learning Augmented Heterogeneous Graph Neural Network for Social Recommendation

HybridGNN: Learning Hybrid Representation for Recommendation in Multiplex Heterogeneous Networks

SR-HGN: Semantic- and Relation-Aware Heterogeneous Graph Neural Network

Heterogeneous Graph Neural Network With Multi-View Representation Learning

CHGNN: A Semi-Supervised Contrastive Hypergraph Learning Network

Hyper-SAGNN: a self-attention based graph neural network for hypergraphs

Heterogeneous Hypergraph Neural Network for Social Recommendation using Attention Network

SHGCN: Socially Enhanced Heterogeneous Graph Convolutional Network for Multi-Behavior Prediction

Ha-gnn: a novel graph neural network based on hyperbolic attention