MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models

Yilin Wen,Zifeng Wang,Jimeng Sun

2024-03-02

Abstract:Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating hallucinations, and explaining their reasoning process. To address these challenges, we propose a novel prompting pipeline, named \method, that leverages knowledge graphs (KGs) to enhance LLMs' inference and transparency. Our method enables LLMs to comprehend KG inputs and infer with a combination of implicit and external knowledge. Moreover, our method elicits the mind map of LLMs, which reveals their reasoning pathways based on the ontology of knowledge. We evaluate our method on diverse question \& answering tasks, especially in medical domains, and show significant improvements over baselines. We also introduce a new hallucination evaluation benchmark and analyze the effects of different components of our method. Our results demonstrate the effectiveness and robustness of our method in merging knowledge from LLMs and KGs for combined inference. To reproduce our results and extend the framework further, we make our codebase available at <a class="link-external link-https" href="https://github.com/wyl-willing/MindMap" rel="external noopener nofollow">this https URL</a>.

Artificial Intelligence,Computation and Language,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the following issues:

1. **Flexibility of Knowledge Update**: Pre-trained large language models (LLMs) often contain outdated knowledge and are not flexible enough for parameter updates. Fine-tuning LLMs can be costly or lead to catastrophic forgetting.

2. **Generation of Hallucinations**: LLMs are prone to producing outputs that sound plausible but are incorrect, which is particularly severe in high-risk applications such as medical diagnosis.

3. **Lack of Transparency**: Due to their black-box nature, the knowledge in LLMs is stored in their parameters, making it difficult to verify and interpret the reasoning process.

To address these challenges, the authors propose a new prompting pipeline called **MindMap**, which leverages knowledge graphs (KGs) to enhance the reasoning capability and transparency of LLMs. Specifically, the MindMap approach enables LLMs to understand KG inputs and reason with both implicit and external knowledge. Additionally, this method reveals the mind map of LLMs, showcasing their reasoning paths based on knowledge ontology.

By evaluating on various question-answering tasks, especially in the medical domain, the authors demonstrate significant improvements of MindMap over baseline methods. They also introduce a new hallucination evaluation benchmark and analyze the effects of different components. Experimental results show that MindMap is effective and robust in combining the knowledge of LLMs and KGs for joint reasoning.