Abstract:The incompleteness of knowledge graphs (KGs) negatively impacts the performance of KGs in downstream applications (e.g., recommendation systems and information retrieval). This phenomenon has brought an increasing rise in research related to knowledge graph reasoning. Recently, emerged reinforcement learning (RL)-based multi-hop reasoning methods can infer missing information through multi-hop reasoning according to the existing information in KGs, which has better reasoning performance and interpretability. However, these methods always use relation-entity pairs that have been pre-cropped as the action space of agents for path reasoning, which leads to two problems: 1) insufficient learning and reasoning ability of reasoning models and 2) the hard convergence of the training process of agents. To address these problems, we propose a Hierarchical Sequence Multi Hop (HSMH) reasoning framework, which consists of the interactive search reasoning model, local-global knowledge fusion mechanism, and action optimization mechanism. We use interactive search reasoning models to select relations and entities independently, thus fully mining the semantic information of relations and entities and improving the learning and reasoning ability of reasoning models. In the HSMH framework, we design the local-global knowledge fusion and action optimization mechanisms for path reasoning, which can enhance agents' state information and action space. Specifically, the local-global knowledge fusion mechanism is designed to acquire the local knowledge of entities and neighboring relations and the global knowledge about KG structure. This local-global knowledge can improve the learning ability of reasoning models. In addition, the action optimization mechanism can combine the filtered action space and the additional action space for efficient path reasoning for agents. Experimental results on five benchmark datasets show that our proposed HSMH framework comprehensively outperforms the state-of-the-art multi-hop reasoning model.

Multi-hop Reading Comprehension Incorporating Sentence-Based Reasoning.

Multi-hop Reading Comprehension via Deep Reinforcement Learning based Document Traversal

Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs

Multi-hop Question Answering via Reasoning Chains

Multi-hop Reading Comprehension Across Documents with Path-based Graph Convolutional Network

Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategy

Towards Human-level Machine Reading Comprehension: Reasoning and Inference with Multiple Strategies.

Multi-Matching Network for Multiple Choice Reading Comprehension

Locate then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

Read, Attend, and Exclude: Multi-Choice Reading Comprehension by Mimicking Human Reasoning Process

Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering

HSMH: A Hierarchical Sequence Multi-Hop Reasoning Model With Reinforcement Learning

Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents

Text Reasoning Chain Extraction for Multi-Hop Question Answering

MoreHopQA: More Than Multi-hop Reasoning

Multi-grained Evidence Inference for Multi-choice Reading Comprehension

Graph-based Multi-hop Reasoning for Long Text Generation.

Exploiting Reasoning Chains for Multi-hop Science Question Answering

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension