Abstract:Knowledge graph question answering (KGQA) aims to answer natural language questions from structured knowledge graphs (KGs). Traditional KQGA methods are usually limited to single-hop queries and cannot handle complex questions involving multi-hop reasoning well. To overcome this issue, multi-hop KGQA based on reinforcement learning (RL) has been proposed. However, multi-hop KGQA based on RL still faces some challenges. Firstly, due to the insufficient availability of latent environmental information during the reasoning process, the agent finds it challenging to make coherent and correct decisions. Secondly, the agent only receives rewards from the environment upon reaching the answer entity during the exploration, leading to slow or even obstructed learning. To address these shortcomings, we construct multi-perspective information based on the state of the environment, and integrate multi-perspective information with RL framework, thereby creating the Multi-Perspective Information Fusion Reasoning Network (MPIFRN). MPIFRN achieves the goal via three steps. (1) We construct three different views of information, i.e., expectation embedding, instruction-guided embedding, and path-aware embedding. These environmental cues provide more reliable support for decision-making. (2) We still adopt the method of mapping entities and relations into the knowledge graph embedding space to answer multi-hop questions. At each step of reasoning, we use a scoring function to measure the plausibility of each "triple" ¡topic entity, question, candidate entity¿ in the embedding space. (3) Furthermore, we employ the asynchronous advantage actor-critic (A3C) algorithm to guide the agent in selecting the most promising entities and to expand the reasoning paths in parallel by updating policy and value network parameters, thereby facilitating multi-hop knowledge graph question answering. We conduct extensive experiments on KGQA benchmark datasets, providing substantial evidence to demonstrate the effectiveness of our approach.

Counterfactual-Guided and Curiosity-Driven Multi-hop Reasoning over Knowledge Graph

Attention-based Exploitation and Exploration Strategy for Multi-Hop Knowledge Graph Reasoning

CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning

Multi-Hop Knowledge Graph Reasoning with Reward Shaping

Multi-hop Knowledge Reasoning with Deep Reinforcement Learning

Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph

Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques

Unrestricted multi-hop reasoning network for interpretable question answering over knowledge graph

Counterfactual Reasoning with Knowledge Graph Embeddings

Multi-hop question answering over incomplete knowledge graph with abstract conceptual evidence

Neural Axiom Network for Knowledge Graph Reasoning

Multi-hop reasoning over paths in temporal knowledge graphs using reinforcement learning

Look Globally and Reason: Two-stage Path Reasoning over Sparse Knowledge Graphs

Incorporating multi-perspective information into reinforcement learning to address multi-hop knowledge graph question answering

Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Causal Reinforcement Learning for Knowledge Graph Reasoning

UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph

Step by Step: A Hierarchical Framework for Multi-Hop Knowledge Graph Reasoning with Reinforcement Learning

HSMH: A Hierarchical Sequence Multi-Hop Reasoning Model With Reinforcement Learning

SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning

Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphs