Abstract:Knowledge graph question answering (KGQA) aims to answer natural language questions from structured knowledge graphs (KGs). Traditional KQGA methods are usually limited to single-hop queries and cannot handle complex questions involving multi-hop reasoning well. To overcome this issue, multi-hop KGQA based on reinforcement learning (RL) has been proposed. However, multi-hop KGQA based on RL still faces some challenges. Firstly, due to the insufficient availability of latent environmental information during the reasoning process, the agent finds it challenging to make coherent and correct decisions. Secondly, the agent only receives rewards from the environment upon reaching the answer entity during the exploration, leading to slow or even obstructed learning. To address these shortcomings, we construct multi-perspective information based on the state of the environment, and integrate multi-perspective information with RL framework, thereby creating the Multi-Perspective Information Fusion Reasoning Network (MPIFRN). MPIFRN achieves the goal via three steps. (1) We construct three different views of information, i.e., expectation embedding, instruction-guided embedding, and path-aware embedding. These environmental cues provide more reliable support for decision-making. (2) We still adopt the method of mapping entities and relations into the knowledge graph embedding space to answer multi-hop questions. At each step of reasoning, we use a scoring function to measure the plausibility of each "triple" ¡topic entity, question, candidate entity¿ in the embedding space. (3) Furthermore, we employ the asynchronous advantage actor-critic (A3C) algorithm to guide the agent in selecting the most promising entities and to expand the reasoning paths in parallel by updating policy and value network parameters, thereby facilitating multi-hop knowledge graph question answering. We conduct extensive experiments on KGQA benchmark datasets, providing substantial evidence to demonstrate the effectiveness of our approach.

Reasoning Path Generation for Answering Multi-hop Questions over Knowledge Graph

Multi-Hop Knowledge Graph Reasoning with Reward Shaping

Incorporating multi-perspective information into reinforcement learning to address multi-hop knowledge graph question answering

RPR-KGQA: Relational Path Reasoning for Multi-hop Question Answering with Knowledge Graph

Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision

UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph

Attention-based Exploitation and Exploration Strategy for Multi-Hop Knowledge Graph Reasoning

Multi-hop Knowledge Graph Reasoning Based on Hyperbolic Knowledge Graph Embedding and Reinforcement Learning

Unrestricted multi-hop reasoning network for interpretable question answering over knowledge graph

Multi-hop question answering over incomplete knowledge graph with abstract conceptual evidence

Question-Directed Reasoning with Relation-Aware Graph Attention Network for Complex Question Answering over Knowledge Graph

GaussianPath: A Bayesian Multi-Hop Reasoning Framework for Knowledge Graph Reasoning.

Exploiting Hybrid Semantics of Relation Paths for Multi-hop Question Answering Over Knowledge Graphs

A Method for Complex Question-Answering over Knowledge Graph

Improving embedded knowledge graph multi-hop question answering by introducing relational chain reasoning

ExKGR: Explainable Multi-hop Reasoning for Evolving Knowledge Graph

Query Path Generation via Bidirectional Reasoning for Multi-hop Question Answering from Knowledge Bases

Path Spuriousness-aware Reinforcement Learning for Multi-Hop Knowledge Graph Reasoning.

Query Path Generation Via Bidirectional Reasoning for Multihop Question Answering from Knowledge Bases

Stepwise relation prediction with dynamic reasoning network for multi-hop knowledge graph question answering

Hic-KGQA: Improving multi-hop question answering over knowledge graph via hypergraph and inference chain