Abstract:The incompleteness of knowledge graphs (KGs) negatively impacts the performance of KGs in downstream applications (e.g., recommendation systems and information retrieval). This phenomenon has brought an increasing rise in research related to knowledge graph reasoning. Recently, emerged reinforcement learning (RL)-based multi-hop reasoning methods can infer missing information through multi-hop reasoning according to the existing information in KGs, which has better reasoning performance and interpretability. However, these methods always use relation-entity pairs that have been pre-cropped as the action space of agents for path reasoning, which leads to two problems: 1) insufficient learning and reasoning ability of reasoning models and 2) the hard convergence of the training process of agents. To address these problems, we propose a Hierarchical Sequence Multi Hop (HSMH) reasoning framework, which consists of the interactive search reasoning model, local-global knowledge fusion mechanism, and action optimization mechanism. We use interactive search reasoning models to select relations and entities independently, thus fully mining the semantic information of relations and entities and improving the learning and reasoning ability of reasoning models. In the HSMH framework, we design the local-global knowledge fusion and action optimization mechanisms for path reasoning, which can enhance agents' state information and action space. Specifically, the local-global knowledge fusion mechanism is designed to acquire the local knowledge of entities and neighboring relations and the global knowledge about KG structure. This local-global knowledge can improve the learning ability of reasoning models. In addition, the action optimization mechanism can combine the filtered action space and the additional action space for efficient path reasoning for agents. Experimental results on five benchmark datasets show that our proposed HSMH framework comprehensively outperforms the state-of-the-art multi-hop reasoning model.

Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Multi-modal Knowledge-aware Reinforcement Learning Network for Explainable Recommendation

Reinforcement Knowledge Graph Reasoning for Explainable Recommendation

Reason more like human: Incorporating meta information into hierarchical reinforcement learning for knowledge graph reasoning

A Joint Framework for Explainable Recommendation with Knowledge Reasoning and Graph Representation

Explainable Reasoning over Knowledge Graphs for Recommendation

Dynamic knowledge graph reasoning based on deep reinforcement learning

KR-GCN: Knowledge-aware Reasoning with Graph Convolution Network for Explainable Recommendation

Multi-Hop Knowledge Graph Reasoning with Reward Shaping

HSMH: A Hierarchical Sequence Multi-Hop Reasoning Model With Reinforcement Learning

Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques

KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation

Neural-Symbolic Reasoning over Knowledge Graph for Multi-stage Explainable Recommendation

CADRL: Category-aware Dual-agent Reinforcement Learning for Explainable Recommendations over Knowledge Graphs

Knowledge Graph Representation Reasoning for Recommendation System

Reinforcement recommendation reasoning through knowledge graphs for explanation path quality

Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation

Multi-hop reasoning over paths in temporal knowledge graphs using reinforcement learning

Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs

Multi-modal Recommendation Based on Knowledge Graph

CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning