Abstract:While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate knowledge updating, and limited transparency in the reasoning process. To overcome these limitations, this study innovatively proposes a collaborative training-free reasoning scheme involving tight cooperation between Knowledge Graph (KG) and LLMs. This scheme first involves using LLMs to iteratively explore KG, selectively retrieving a task-relevant knowledge subgraph to support reasoning. The LLMs are then guided to further combine inherent implicit knowledge to reason on the subgraph while explicitly elucidating the reasoning process. Through such a cooperative approach, our scheme achieves more reliable knowledge-based reasoning and facilitates the tracing of the reasoning results. Experimental results show that our scheme significantly progressed across multiple datasets, notably achieving over a 10% improvement on the QALD10 dataset compared to the best baseline and the fine-tuned state-of-the-art (SOTA) work. Building on this success, this study hopes to offer a valuable reference for future research in the fusion of KG and LLMs, thereby enhancing LLMs' proficiency in solving complex issues.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to address the issues encountered by large language models (LLMs) in practical applications, specifically including the following aspects: 1. **Hallucinations**: Although LLMs perform excellently in generating text, they struggle to maintain factual accuracy and may provide seemingly reasonable but incorrect answers. This is particularly concerning in critical fields such as medical diagnosis and financial decision-making. 2. **Insufficient knowledge updates**: LLMs find it difficult to handle complex and specialized reasoning tasks beyond their training scope. Additionally, due to the continuous updating of external world knowledge and the substantial resources required for training, it is challenging for LLMs to stay up-to-date. 3. **Opaque reasoning process**: Due to the complex internal parameters of LLMs, their reasoning process lacks transparency, affecting interpretability. To overcome these limitations, the study proposes an innovative collaborative training-no reasoning scheme, which achieves more reliable knowledge reasoning through the close cooperation of knowledge graphs (KG) and LLMs. The specific method includes using LLMs to iteratively explore the KG, selectively retrieving task-relevant knowledge subgraphs, and combining the intrinsic implicit knowledge of LLMs for reasoning while explicitly explaining the reasoning process. Through this collaborative approach, the scheme significantly improves performance on multiple datasets, achieving over a 10% improvement on the QALD10 dataset compared to the best baseline and state-of-the-art methods.

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data

CuriousLLM: Elevating Multi-Document QA with Reasoning-Infused Knowledge Graph Prompting

Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering

LLM-based Discriminative Reasoning for Knowledge Graph Question Answering

Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion

LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning

A Framework of Knowledge Graph-Enhanced Large Language Model Based on Question Decomposition and Atomic Retrieval

KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph

Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

Chain-of-Knowledge: Integrating Knowledge Reasoning into Large Language Models by Learning from Knowledge Graphs

Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning

KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph

Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models

LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities

ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph

Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering

Reasoning on Efficient Knowledge Paths:Knowledge Graph Guides Large Language Model for Domain Question Answering

Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning

Evaluating and Enhancing Large Language Models for Conversational Reasoning on Knowledge Graphs