Explainable Reasoning over Knowledge Graph Paths for Recommendation

Xiang Wang,Dingxian Wang,Canran Xu,Xiangnan He,Yixin Cao,Tat-Seng Chua

2019-01-01

Abstract:Skip navigation …

What problem does this paper attempt to address?

Explainable Reasoning over Knowledge Graphs for Recommendation

Xiang Wang,Dingxian Wang,Canran Xu,Xiangnan He,Yixin Cao,Tat-Seng Chua

DOI: https://doi.org/10.1609/aaai.v33i01.33015329

2019-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Incorporating knowledge graph into recommender systems has attracted increasing attention in recent years. By exploring the interlinks within a knowledge graph, the connectivity between users and items can be discovered as paths, which provide rich and complementary information to user-item interactions. Such connectivity not only reveals the semantics of entities and relations, but also helps to comprehend a user's interest. However, existing efforts have not fully explored this connectivity to infer user preferences, especially in terms of modeling the sequential dependencies within and holistic semantics of a path. In this paper, we contribute a new model named Knowledge-aware Path Recurrent Network (KPRN) to exploit knowledge graph for recommendation. KPRN can generate path representations by composing the semantics of both entities and relations. By leveraging the sequential dependencies within a path, we allow effective reasoning on paths to infer the underlying rationale of a user-item interaction. Furthermore, we design a new weighted pooling operation to discriminate the strengths of different paths in connecting a user with an item, endowing our model with a certain level of explainability. We conduct extensive experiments on two datasets about movie and music, demonstrating significant improvements over state-of-the-art solutions Collaborative Knowledge Base Embedding and Neural Factorization Machine.
Reinforcement Knowledge Graph Reasoning for Explainable Recommendation

Yikun Xian,Zuohui Fu,S. Muthukrishnan,Gerard de Melo,Yongfeng Zhang

DOI: https://doi.org/10.1145/3331184.3331203

2019-06-13

Abstract:Recent advances in personalized recommendation have sparked great interest in the exploitation of rich structured information provided by knowledge graphs. Unlike most existing approaches that only focus on leveraging knowledge graphs for more accurate recommendation, we perform explicit reasoning with knowledge for decision making so that the recommendations are generated and supported by an interpretable causal inference procedure. To this end, we propose a method called Policy-Guided Path Reasoning (PGPR), which couples recommendation and interpretability by providing actual paths in a knowledge graph. Our contributions include four aspects. We first highlight the significance of incorporating knowledge graphs into recommendation to formally define and interpret the reasoning process. Second, we propose a reinforcement learning (RL) approach featuring an innovative soft reward strategy, user-conditional action pruning and a multi-hop scoring function. Third, we design a policy-guided graph search algorithm to efficiently and effectively sample reasoning paths for recommendation. Finally, we extensively evaluate our method on several large-scale real-world benchmark datasets, obtaining favorable results compared with state-of-the-art methods.

Information Retrieval,Machine Learning
Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Xiting Wang,Kunpeng Liu,Dongjie Wang,Le Wu,Yanjie Fu,Xing Xie

DOI: https://doi.org/10.1145/3485447.3512083

2022-01-01

Abstract:Knowledge graphs (KGs) have been widely used to improve recommendation accuracy. The multi-hop paths on KGs also enable recommendation reasoning, which is considered a crystal type of explainability. In this paper, we propose a reinforcement learning framework for multi-level recommendation reasoning over KGs, which leverages both ontology-view and instance-view KGs to model multi-level user interests. This framework ensures convergence to a more satisfying solution by effectively transferring high-level knowledge to lower levels. Based on the framework, we propose a multi-level reasoning path extraction method, which automatically selects between high-level concepts and low-level ones to form reasoning paths that better reveal user interests. Experiments on three datasets demonstrate the effectiveness of our method.
Time-aware Path Reasoning on Knowledge Graph for Recommendation

Yuyue Zhao,Xiang Wang,Jiawei Chen,Yashen Wang,Wei Tang,Xiangnan He,Haiyong Xie

DOI: https://doi.org/10.1145/3531267

IF: 4.657

2022-12-21

ACM Transactions on Information Systems

Abstract:Reasoning on knowledge graph (KG) has been studied for explainable recommendation due to its ability of providing explicit explanations. However, current KG-based explainable recommendation methods unfortunately ignore the temporal information (such as purchase time, recommend time, etc.), which may result in unsuitable explanations. In this work, we propose a novel Time-aware Path reasoning for Recommendation (TPRec for short) method, which leverages the potential of temporal information to offer better recommendation with plausible explanations. First, we present an efficient time-aware interaction relation extraction component to construct collaborative knowledge graph with time-aware interactions (TCKG for short), and then we introduce a novel time-aware path reasoning method for recommendation. We conduct extensive experiments on three real-world datasets. The results demonstrate that the proposed TPRec could successfully employ TCKG to achieve substantial gains and improve the quality of explainable recommendation.

computer science, information systems
Neural-Symbolic Reasoning over Knowledge Graph for Multi-stage Explainable Recommendation

Yikun Xian,Zuohui Fu,Qiaoying Huang,S. Muthukrishnan,Yongfeng Zhang

DOI: https://doi.org/10.48550/arXiv.2007.13207

2020-07-27

Abstract:Recent work on recommender systems has considered external knowledge graphs as valuable sources of information, not only to produce better recommendations but also to provide explanations of why the recommended items were chosen. Pure rule-based symbolic methods provide a transparent reasoning process over knowledge graph but lack generalization ability to unseen examples, while deep learning models enhance powerful feature representation ability but are hard to interpret. Moreover, direct reasoning over large-scale knowledge graph can be costly due to the huge search space of pathfinding. We approach the problem through a novel coarse-to-fine neural symbolic reasoning method called NSER. It first generates a coarse-grained explanation to capture abstract user behavioral pattern, followed by a fined-grained explanation accompanying with explicit reasoning paths and recommendations inferred from knowledge graph. We extensively experiment on four real-world datasets and observe substantial gains of recommendation performance compared with state-of-the-art methods as well as more diversified explanations in different granularity.

Information Retrieval
Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs

Kangzhi Zhao,Xiting Wang,Yuren Zhang,Li Zhao,Zheng Liu,Chunxiao Xing,Xing Xie

DOI: https://doi.org/10.1145/3397271.3401171

2020-07-25

Abstract:Knowledge graphs have been widely adopted to improve recommendation accuracy. The multi-hop user-item connections on knowledge graphs also endow reasoning about why an item is recommended. However, reasoning on paths is a complex combinatorial optimization problem. Traditional recommendation methods usually adopt brute-force methods to find feasible paths, which results in issues related to convergence and explainability. In this paper, we address these issues by better supervising the path finding process. The key idea is to extract imperfect path demonstrations with minimum labeling efforts and effectively leverage these demonstrations to guide path finding. In particular, we design a demonstration-based knowledge graph reasoning framework for explainable recommendation. We also propose an ADversarial Actor-Critic (ADAC) model for the demonstration-guided path finding. Experiments on three real-world benchmarks show that our method converges more quickly than the state-of-the-art baseline and achieves better recommendation accuracy and explainability.
Ekar: an Explainable Method for Knowledge Aware Recommendation

Weiping Song,Zhijian Duan,Ziqing Yang,Hao Zhu,Ming Zhang,Jian Tang

DOI: https://doi.org/10.48550/arxiv.1906.09506

2019-01-01

Abstract:This paper studies recommender systems with knowledge graphs, which can effectively address the problems of data sparsity and cold start. Recently, a variety of methods have been developed for this problem, which generally try to learn effective representations of users and items and then match items to users according to their representations. Though these methods have been shown quite effective, they lack good explanations, which are critical to recommender systems. In this paper, we take a different route and propose generating recommendations by finding meaningful paths from users to items. Specifically, we formulate the problem as a sequential decision process, where the target user is defined as the initial state, and the edges on the graphs are defined as actions. We shape the rewards according to existing state-of-the-art methods and then train a policy function with policy gradient methods. Experimental results on three real-world datasets show that our proposed method not only provides effective recommendations but also offers good explanations.
A Joint Framework for Explainable Recommendation with Knowledge Reasoning and Graph Representation

Luhao Zhang,Ruiyu Fang,Tianchi Yang,Maodi Hu,Tao Li,Chuan Shi,Dong Wang

DOI: https://doi.org/10.1007/978-3-031-00129-1_30

2022-01-01

Abstract:With the development of recommendation systems (RSs), researchers are no longer only satisfied with the recommendation results, but also put forward requirements for the recommendation reasons, which helps improve user experience and discover system defects. Recently, some methods develop knowledge graph reasoning via reinforcement learning for explainable recommendation. Different from traditional RSs, these methods generate corresponding paths reasoned from KG to achieve explicit explainability while providing recommended items. But they suffer from a limitation of the fixed representations that are pre-trained on the KG, which leads to a gap between KG representation and explainable recommendation. To tackle this issue, we propose a joint framework for explainable recommendation with knowledge reasoning and graph representation. A sub-graph is constructed from the paths generated through knowledge reasoning and utilized to optimize the KG representations. In this way, knowledge reasoning and graph representation are optimized jointly and form a positive regulation system. Besides, due to more than one candidate in the step of knowledge reasoning, an attention mechanism is also employed to capture the preference. Extensive experiments are conducted on public real-world datasets to show the superior performance of the proposed method. Moreover, the results of the online A/B test on the large-scale Meituan Waimai (MTWM) KG consistently show our method brings benefits to the industry.
Explainable Session-based Recommendation via Path Reasoning

Yang Cao,Shuo Shang,Jun Wang,Wei Zhang

2024-02-28

Abstract:This paper explores providing explainability for session-based recommendation (SR) by path reasoning. Current SR models emphasize accuracy but lack explainability, while traditional path reasoning prioritizes knowledge graph exploration, ignoring sequential patterns present in the session history. Therefore, we propose a generalized hierarchical reinforcement learning framework for SR, which improves the explainability of existing SR models via Path Reasoning, namely PR4SR. Considering the different importance of items to the session, we design the session-level agent to select the items in the session as the starting point for path reasoning and the path-level agent to perform path reasoning. In particular, we design a multi-target reward mechanism to adapt to the skip behaviors of sequential patterns in SR, and introduce path midpoint reward to enhance the exploration efficiency in knowledge graphs. To improve the completeness of the knowledge graph and to diversify the paths of explanation, we incorporate extracted feature information from images into the knowledge graph. We instantiate PR4SR in five state-of-the-art SR models (i.e., GRU4REC, NARM, GCSAN, SR-GNN, SASRec) and compare it with other explainable SR frameworks, to demonstrate the effectiveness of PR4SR for recommendation and explanation tasks through extensive experiments with these approaches on four datasets.

Information Retrieval,Artificial Intelligence
KR-GCN: Knowledge-aware Reasoning with Graph Convolution Network for Explainable Recommendation

Ting Ma,Longtao Huang,Qianqian Lu,Songlin Hu

DOI: https://doi.org/10.1145/3511019

IF: 4.657

2022-03-15

ACM Transactions on Information Systems

Abstract:Incorporating knowledge graphs (KGs) into recommender systems to provide explainable recommendation has attracted much attention recently. The multi-hop paths in KGs can provide auxiliary facts for improving recommendation performance as well as explainability. However, existing studies may suffer from two major challenges: error propagation and weak explainability. Considering all paths between every user-item pair might involve irrelevant ones, which leads to error propagation of user preferences. Defining meta-paths might alleviate the error propagation, but the recommendation performance would heavily depend on the pre-defined meta-paths. Some recent methods based on graph convolution network (GCN) achieve better recommendation performance, but fail to provide explainability. To tackle the above problems, we propose a novel method named K nowledge-aware R easoning with G raph C onvolution N etwork (KR-GCN). Specifically, to alleviate the effect of error propagation, we design a transition-based method to determine the triple-level scores and utilize nucleus sampling to select triples within the paths between every user-item pair adaptively. To improve the recommendation performance and guarantee the diversity of explanations, user-item interactions and knowledge graphs are integrated into a heterogeneous graph, which is performed with the graph convolution network. A path-level self-attention mechanism is adopted to discriminate the contributions of different selected paths and predict the interaction probability, which improves the relevance of the final explanation. Extensive experiments conducted on three real-world datasets show that KR-GCN consistently outperforms several state-of-the-art baselines. And human evaluation proves the superiority of KR-GCN on explainability.

computer science, information systems
Knowledge Graph Representation Reasoning for Recommendation System

Tao Li,Hao Li,Sheng Zhong,Yan Kang,Yachuan Zhang,Rongjing Bu,Yang Hu

DOI: https://doi.org/10.32604/jnm.2020.09767

2020-01-01

Journal of New Media

Abstract:: In view of the low interpretability of existing collaborative filtering recommendation algorithms and the difficulty of extracting information from content-based recommendation algorithms, we propose an efficient KGRS model. KGRS first obtains reasoning paths of knowledge graph and embeds the entities of paths into vectors based on knowledge representation learning TransD algorithm, then uses LSTM and soft attention mechanism to capture the semantic of each path reasoning, then uses convolution operation and pooling operation to distinguish the importance of different paths reasoning. Finally, through the full connection layer and sigmoid function to get the prediction ratings, and the items are sorted according to the prediction ratings to get the user’s recommendation list. KGRS is tested on the movielens-100k dataset. Compared with the related representative algorithm, including the state-of-the-art interpretable recommendation models RKGE and RippleNet, the experimental results show that KGRS has good recommendation interpretation and higher recommendation accuracy.
Multi-hop reasoning over paths in temporal knowledge graphs using reinforcement learning

Luyi Bai,Wenting Yu,Mingzhuo Chen,Xiangnan Ma

DOI: https://doi.org/10.1016/j.asoc.2021.107144

IF: 8.7

2021-05-01

Applied Soft Computing

Abstract:Knowledge graphs (KGs) are usually incomplete—many new facts can be inferred from KGs with existing information. In some traditional reasoning methods, temporal information is not taken into consideration, meaning that only triplets (head, relation, tail) are trained. In current dynamic knowledge graphs, it is a challenge to consider the temporal aspects of facts. Recent temporal reasoning methods embed temporal information into low-dimensional spaces. These methods mainly support implicitly reasoning, which means they cannot get the specific reasoning paths. These methods limit the accuracy of reasoning paths and ignore multiple explainable reasoning paths in temporal knowledge graphs (TKGs). To overcome this limitation, we propose a multi-hop reasoning model TPath in this paper. It is a reinforcement learning (RL) framework which can learn multi-hop reasoning paths and continuously adjust the reasoning paths in TKGs. More importantly, we add time vectors in reasoning paths, which further improve the accuracy of reasoning paths. Meanwhile, considering the diversity of temporal reasoning paths, we propose a new reward function. In TPath, the agent employs the Long Short-Term Memory networks (LSTM) to capture current observations from the environment, and it outputs action vectors (relation vectors and time vectors) to the environment through activation functions. Experimentally, our model outperforms other state-of-the-art reasoning methods in several aspects over two public temporal knowledge graph datasets.

computer science, artificial intelligence, interdisciplinary applications
Reinforcement recommendation reasoning through knowledge graphs for explanation path quality

Giacomo Balloccu,Ludovico Boratto,Gianni Fenu,Mirko Marras

DOI: https://doi.org/10.1016/j.knosys.2022.110098

2022-11-30

Abstract:Numerous Knowledge Graphs (KGs) are being created to make Recommender Systems (RSs) not only intelligent but also knowledgeable. Integrating a KG in the recommendation process allows the underlying model to extract reasoning paths between recommended products and already experienced products from the KG. These paths can be leveraged to generate textual explanations to be provided to the user for a given recommendation. However, the existing explainable recommendation approaches based on KG merely optimize the selected reasoning paths for product relevance, without considering any user-level property of the paths for explanation. In this paper, we propose a series of quantitative properties that monitor the quality of the reasoning paths from an explanation perspective, based on recency, popularity, and diversity. We then combine in- and post-processing approaches to optimize for both recommendation quality and reasoning path quality. Experiments on three public data sets show that our approaches significantly increase reasoning path quality according to the proposed properties, while preserving recommendation quality. Source code, data sets, and KGs are available at https://tinyurl.com/bdbfzr4n.

computer science, artificial intelligence
CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning

Zhengxiao Du,Chang Zhou,Jiangchao Yao,Teng Tu,Letian Cheng,Hongxia Yang,Jingren Zhou,Jie Tang

DOI: https://doi.org/10.1109/TKDE.2021.3104310

2021-01-01

Abstract:Inferring new facts from an existing knowledge graph with explainable reasoning processes is an important problem, known as knowledge graph (KG) reasoning. The problem is often formulated as finding the specific path that represents the query relation and connects the query entity and the correct answer. However, due to the limited expressiveness of individual paths, the majority of previous works failed to capture the complex subgraph structure in the graph. We propose CogKR that traverses the knowledge graph to conduct multi-hop reasoning. More specifically, motivated by the dual process theory from cognitive science, our framework is composed of an extension module and a reasoning module. By setting up a cognitive graph through iteratively coordinating the two modules, CogKR can cope with more complex reasoning scenarios in the form of subgraphs instead of individual paths. Experiments on three knowledge graph reasoning benchmarks demonstrate that CogKR achieves significant improvements in accuracy compared with previous methods while providing the explainable capacity. Moreover, we evaluate CogKR on the challenging one-shot link prediction task, exhibiting the superiority of the framework on accuracy and scalability compared to the state-of-the-art approaches.
Jointly Learning Explainable Rules for Recommendation with Knowledge Graph

Weizhi Ma,Min Zhang,Yue Cao,Woojeong,Chenyang Wang,Yiqun Liu,Shaoping Ma,Xiang Ren

DOI: https://doi.org/10.48550/arXiv.1903.03714

2019-03-09

Abstract:Explainability and effectiveness are two key aspects for building recommender systems. Prior efforts mostly focus on incorporating side information to achieve better recommendation performance. However, these methods have some weaknesses: (1) prediction of neural network-based embedding methods are hard to explain and debug; (2) symbolic, graph-based approaches (e.g., meta path-based models) require manual efforts and domain knowledge to define patterns and rules, and ignore the item association types (e.g. substitutable and complementary). In this paper, we propose a novel joint learning framework to integrate \textit{induction of explainable rules from knowledge graph} with \textit{construction of a rule-guided neural recommendation model}. The framework encourages two modules to complement each other in generating effective and explainable recommendation: 1) inductive rules, mined from item-centric knowledge graphs, summarize common multi-hop relational patterns for inferring different item associations and provide human-readable explanation for model prediction; 2) recommendation module can be augmented by induced rules and thus have better generalization ability dealing with the cold-start issue. Extensive experiments\footnote{Code and data can be found at: \url{<a class="link-external link-https" href="https://github.com/THUIR/RuleRec" rel="external noopener nofollow">this https URL</a>}} show that our proposed method has achieved significant improvements in item recommendation over baselines on real-world datasets. Our model demonstrates robust performance over "noisy" item knowledge graphs, generated by linking item names to related entities.

Information Retrieval,Artificial Intelligence,Machine Learning
Attention Is Not the Only Choice: Counterfactual Reasoning for Path-Based Explainable Recommendation

Yicong Li,Xiangguo Sun,Hongxu Chen,Sixiao Zhang,Yu Yang,Guandong Xu

DOI: https://doi.org/10.1109/TKDE.2024.3373608

2024-03-03

Abstract:Compared with only pursuing recommendation accuracy, the explainability of a recommendation model has drawn more attention in recent years. Many graph-based recommendations resort to informative paths with the attention mechanism for the explanation. Unfortunately, these attention weights are intentionally designed for model accuracy but not explainability. Recently, some researchers have started to question attention-based explainability because the attention weights are unstable for different reproductions, and they may not always align with human intuition. Inspired by the counterfactual reasoning from causality learning theory, we propose a novel explainable framework targeting path-based recommendations, wherein the explainable weights of paths are learned to replace attention weights. Specifically, we design two counterfactual reasoning algorithms from both path representation and path topological structure perspectives. Moreover, unlike traditional case studies, we also propose a package of explainability evaluation solutions with both qualitative and quantitative methods. We conduct extensive experiments on three real-world datasets, the results of which further demonstrate the effectiveness and reliability of our method.

Information Retrieval
Look Globally and Reason: Two-stage Path Reasoning over Sparse Knowledge Graphs

Saiping Guan,Jiyao Wei,Xiaolong Jin,Jiafeng Guo,Xueqi Cheng

2024-07-26

Abstract:Sparse Knowledge Graphs (KGs), frequently encountered in real-world applications, contain fewer facts in the form of (head entity, relation, tail entity) compared to more populated KGs. The sparse KG completion task, which reasons answers for given queries in the form of (head entity, relation, ?) for sparse KGs, is particularly challenging due to the necessity of reasoning missing facts based on limited facts. Path-based models, known for excellent explainability, are often employed for this task. However, existing path-based models typically rely on external models to fill in missing facts and subsequently perform path reasoning. This approach introduces unexplainable factors or necessitates meticulous rule design. In light of this, this paper proposes an alternative approach by looking inward instead of seeking external assistance. We introduce a two-stage path reasoning model called LoGRe (Look Globally and Reason) over sparse KGs. LoGRe constructs a relation-path reasoning schema by globally analyzing the training data to alleviate the sparseness problem. Based on this schema, LoGRe then aggregates paths to reason out answers. Experimental results on five benchmark sparse KG datasets demonstrate the effectiveness of the proposed LoGRe model.

Machine Learning,Artificial Intelligence
Dynamic knowledge graph reasoning based on deep reinforcement learning

Hao Liu,Shuwang Zhou,Changfang Chen,Tianlei Gao,Jiyong Xu,Minglei Shu

DOI: https://doi.org/10.1016/j.knosys.2022.108235

2022-04-01

Abstract:Knowledge graph reasoning is a task of reasoning new knowledge or conclusions based on existing knowledge. Recently, reinforcement learning has become a new technical tool for knowledge graph reasoning. However, most previous work focuses on the short fixed-step multi-hop reasoning or the single-step reasoning. In this paper, a dynamic knowledge graph reasoning framework is proposed based on deep reinforcement learning, which learns to navigate the graph to find the promising target answer conditioned on the input query. A novel reward function is constructed based on the proposed dynamic reasoning hypothesis, and the dynamic reward is proposed to obtain the dynamic reasoning model. The judgment condition is established to achieve dynamic reasoning, and an embedding model is chosen as the pre-trained model for initialization. The experimental analysis on several typical datasets shows that our model is indeed effective, and can improve over existing path-based knowledge graph reasoning models, and can be further applied to longer reasoning paths with good results.

computer science, artificial intelligence
Knowledge Enhanced Graph Neural Networks for Explainable Recommendation

Ziyu Lyu,Yue Wu,Junjie Lai,Min Yang,Chengming Li,Wei Zhou

DOI: https://doi.org/10.1109/tkde.2022.3142260

IF: 9.235

2022-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Recently, explainable recommendation has attracted increasing attentions, which can make the recommender system more transparent and improve user satisfactions by recommending products with useful explanations. However, existing methods trend to trade-off between the recommendation accuracy and the interpretability of recommendation results. In this manuscript, we propose Knowledge Enhanced Graph Neural Networks (KEGNN) for explainable recommendation. Semantic knowledge from the external knowledge base is leveraged into representation learning of three sides, respectively user, items and user-item interactions, and the knowledge enhanced semantic embedding are exploited to initialize the user/item entities and user-item relations of one constructed user behavior graph. We design a graph neural networks based user behavior learning and reasoning model to perform both semantic and relational knowledge propagation and reasoning over the user behavior graph for comprehensive understanding of user behaviors. On the top of comprehensive representations of users/items and user-item interactions, hierarchical neural collaborative filtering layers are developed for precise rating prediction, and one generation-mode and copy-mode combined generator is devised for human-like semantic explanation generation by integrating the copy mechanism into gated recurrent neural networks. Quantitative and qualitative results demonstrate the superiority of KEGNN over the state-of-art methods, and the explainability and interpretability of our method.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Multi-Hop Knowledge Graph Reasoning with Reward Shaping

Xi Victoria Lin,Richard Socher,Caiming Xiong

DOI: https://doi.org/10.48550/arXiv.1808.10568

2018-09-12

Abstract:Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its inference path until it reaches a target. However, in an incomplete KG environment, the agent receives low-quality rewards corrupted by false negatives in the training data, which harms generalization at test time. Furthermore, since no golden action sequence is used for training, the agent can be misled by spurious search trajectories that incidentally lead to the correct answer. We propose two modeling advances to address both issues: (1) we reduce the impact of false negative supervision by adopting a pretrained one-hop embedding model to estimate the reward of unobserved facts; (2) we counter the sensitivity to spurious paths of on-policy RL by forcing the agent to explore a diverse set of paths using randomly generated edge masks. Our approach significantly improves over existing path-based KGQA models on several benchmark datasets and is comparable or better than embedding-based models.

Artificial Intelligence,Computation and Language,Machine Learning

Explainable Reasoning over Knowledge Graph Paths for Recommendation

Explainable Reasoning over Knowledge Graphs for Recommendation

Reinforcement Knowledge Graph Reasoning for Explainable Recommendation

Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Time-aware Path Reasoning on Knowledge Graph for Recommendation

Neural-Symbolic Reasoning over Knowledge Graph for Multi-stage Explainable Recommendation

Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs

Ekar: an Explainable Method for Knowledge Aware Recommendation

A Joint Framework for Explainable Recommendation with Knowledge Reasoning and Graph Representation

Explainable Session-based Recommendation via Path Reasoning

KR-GCN: Knowledge-aware Reasoning with Graph Convolution Network for Explainable Recommendation

Knowledge Graph Representation Reasoning for Recommendation System

Multi-hop reasoning over paths in temporal knowledge graphs using reinforcement learning

Reinforcement recommendation reasoning through knowledge graphs for explanation path quality

CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning

Jointly Learning Explainable Rules for Recommendation with Knowledge Graph

Attention Is Not the Only Choice: Counterfactual Reasoning for Path-Based Explainable Recommendation

Look Globally and Reason: Two-stage Path Reasoning over Sparse Knowledge Graphs

Dynamic knowledge graph reasoning based on deep reinforcement learning

Knowledge Enhanced Graph Neural Networks for Explainable Recommendation

Multi-Hop Knowledge Graph Reasoning with Reward Shaping