Abstract:Knowledge graph question answering (KGQA) aims to answer natural language questions from structured knowledge graphs (KGs). Traditional KQGA methods are usually limited to single-hop queries and cannot handle complex questions involving multi-hop reasoning well. To overcome this issue, multi-hop KGQA based on reinforcement learning (RL) has been proposed. However, multi-hop KGQA based on RL still faces some challenges. Firstly, due to the insufficient availability of latent environmental information during the reasoning process, the agent finds it challenging to make coherent and correct decisions. Secondly, the agent only receives rewards from the environment upon reaching the answer entity during the exploration, leading to slow or even obstructed learning. To address these shortcomings, we construct multi-perspective information based on the state of the environment, and integrate multi-perspective information with RL framework, thereby creating the Multi-Perspective Information Fusion Reasoning Network (MPIFRN). MPIFRN achieves the goal via three steps. (1) We construct three different views of information, i.e., expectation embedding, instruction-guided embedding, and path-aware embedding. These environmental cues provide more reliable support for decision-making. (2) We still adopt the method of mapping entities and relations into the knowledge graph embedding space to answer multi-hop questions. At each step of reasoning, we use a scoring function to measure the plausibility of each "triple" ¡topic entity, question, candidate entity¿ in the embedding space. (3) Furthermore, we employ the asynchronous advantage actor-critic (A3C) algorithm to guide the agent in selecting the most promising entities and to expand the reasoning paths in parallel by updating policy and value network parameters, thereby facilitating multi-hop knowledge graph question answering. We conduct extensive experiments on KGQA benchmark datasets, providing substantial evidence to demonstrate the effectiveness of our approach.

A Mixed Knowledge Adaptive Reasoning and Controlling Based on Agent

Fuzzy Cognitive Map Based Agent Reasoning Model

Product Knowledge Reasoning

ANGLE: an Autonomous, Normative and Guidable Agent with Changing Knowledge.

Logic-based Knowledge Awareness for Autonomous Agents in Continuous Spaces

Incorporating multi-perspective information into reinforcement learning to address multi-hop knowledge graph question answering

Knowledge-aware adaptive graph network for commonsense question answering

KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph

Knowledge Aware Conversation Generation with Reasoning on Augmented Graph

Heterogeneous multi-Agent reinforcement learning algorithm integrating Prior-knowledge

Reasoning in artificial intelligence:advances and challenges

Cautiously-Optimistic Knowledge Sharing for Cooperative Multi-Agent Reinforcement Learning

A Domain-Independent Agent Architecture for Adaptive Operation in Evolving Open Worlds

HSMH: A Hierarchical Sequence Multi-Hop Reasoning Model With Reinforcement Learning

Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning

CBR AND RBR INTEGRATED METHOD IN RECONFIGURABLE KNOWLEDGE MANAGEMENT SYSTEM

SAT-based Algorithm for Knowledge Reasoning

Towards Unified Representations of Knowledge Graph and Expert Rules for Machine Learning and Reasoning.

Robot Representation and Reasoning with Knowledge from Reinforcement Learning

Systematizing heterogeneous expert knowledge, scenarios and goals via a goal-reasoning artificial intelligence agent for democratic urban land use planning

KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents