Abstract:Although large language models (LLMs) have achieved significant success in various tasks, they often struggle with hallucination problems, especially in scenarios requiring deep and responsible reasoning. These issues could be partially addressed by introducing external knowledge graphs (KG) in LLM reasoning. In this paper, we propose a new LLM-KG integrating paradigm ``$\hbox{LLM}\otimes\hbox{KG}$'' which treats the LLM as an agent to interactively explore related entities and relations on KGs and perform reasoning based on the retrieved knowledge. We further implement this paradigm by introducing a new approach called Think-on-Graph (ToG), in which the LLM agent iteratively executes beam search on KG, discovers the most promising reasoning paths, and returns the most likely reasoning results. We use a number of well-designed experiments to examine and illustrate the following advantages of ToG: 1) compared with LLMs, ToG has better deep reasoning power; 2) ToG has the ability of knowledge traceability and knowledge correctability by leveraging LLMs reasoning and expert feedback; 3) ToG provides a flexible plug-and-play framework for different LLMs, KGs and prompting strategies without any additional training cost; 4) the performance of ToG with small LLM models could exceed large LLM such as GPT-4 in certain scenarios and this reduces the cost of LLM deployment and application. As a training-free method with lower computational cost and better generality, ToG achieves overall SOTA in 6 out of 9 datasets where most previous SOTAs rely on additional training.

Enhancing Knowledge Graph Consistency through Open Large Language Models: A Case Study

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Knowledge-based Consistency Testing of Large Language Models

Large Language Models Can Better Understand Knowledge Graphs Than We Thought

Synergizing Knowledge Graphs with Large Language Models: A Comprehensive Review and Future Prospects

Combining large language models with enterprise knowledge graphs: a perspective on enhanced natural language understanding

Knowledge Graph-Enhanced Large Language Models via Path Selection

Combining Knowledge Graphs and Large Language Models

Logical Consistency of Large Language Models in Fact-checking

KGLens: Towards Efficient and Effective Knowledge Probing of Large Language Models with Knowledge Graphs

Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study over Open-ended Question Answering

Reasoning about concepts with LLMs: Inconsistencies abound

Enhancing Knowledge Graph Construction Using Large Language Models

Exploring Large Language Models for Knowledge Graph Completion

KGValidator: A Framework for Automatic Validation of Knowledge Graph Construction

Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data

A New Pipeline for Knowledge Graph Reasoning Enhanced by Large Language Models Without Fine-Tuning

LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities

Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answering

Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling