Abstract:To provide more accurate, diverse, and explainable recommendation, it is compulsory to go beyond modeling user-item interactions and take side information into account. Traditional methods like factorization machine (FM) cast it as a supervised learning problem, which assumes each interaction as an independent instance with side information encoded. Due to the overlook of the relations among instances or items (e.g., the director of a movie is also an actor of another movie), these methods are insufficient to distill the collaborative signal from the collective behaviors of users.In this work, we investigate the utility of knowledge graph (KG), which breaks down the independent interaction assumption by linking items with their attributes. We argue that in such a hybrid structure of KG and user-item graph, high-order relations which connect two items with one or multiple linked attributes are an essential factor for successful recommendation. We propose a new method named Knowledge Graph Attention Network (KGAT) which explicitly models the high-order connectivities in KG in an end-to-end fashion. It recursively propagates the embeddings from a node's neighbors (which can be users, items, or attributes) to refine the node's embedding, and employs an attention mechanism to discriminate the importance of the neighbors. Our KGAT is conceptually advantageous to existing KG-based recommendation methods, which either exploit highorder relations by extracting paths or implicitly modeling them with regularization. Empirical results on three public benchmarks show that KGAT significantly outperforms state-of-the-art methods like Neural FM [11] and RippleNet [29]. Further studies verify the efficacy of embedding propagation for high-order relation modeling and the interpretability benefits brought by the attention mechanism. We release the codes and datasets at https://github.com/xiangwang1223/knowledge_graph_attention_network.

KGAnet: a Knowledge Graph Attention Network for Enhancing Natural Language Inference

Knowledge Adaptive Neural Network for Natural Language Inference.

Natural Language Inference with External Knowledge.

Neural Natural Language Inference Models Enhanced with External Knowledge

Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge

Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding

Neural Axiom Network for Knowledge Graph Reasoning

GS-InGAT: An interaction graph attention network with global semantic for knowledge graph completion

Learning beyond datasets: Knowledge Graph Augmented Neural Networks for Natural language Processing

Knowledge Graph Embedding Via Graph Attenuated Attention Networks

A data-centric framework of improving graph neural networks for knowledge graph embedding

Analogical Inference Enhanced Knowledge Graph Embedding

A Knowledge Graph Embedding Method Based on Neural Network

Kgat: Knowledge Graph Attention Network For Recommendation

Unsupervised Knowledge Graph Construction and Event-centric Knowledge Infusion for Scientific NLI

Neural Knowledge Acquisition via Mutual Attention Between Knowledge Graph and Text.

Knowledge Graph Alignment Network with Gated Multi-Hop Neighborhood Aggregation

Multi-source Inductive Knowledge Graph Transfer

Knowledge-aware fine-grained attention networks with refined knowledge graph embedding for personalized recommendation

Double-Branch Multi-Attention based Graph Neural Network for Knowledge Graph Completion

Hierarchical Perceptual Graph Attention Network for Knowledge Graph Completion