Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning

Linhao Luo,Yuan-Fang Li,Gholamreza Haffari,Shirui Pan

2024-02-24

Abstract:Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can lead to incorrect reasoning processes and diminish their performance and trustworthiness. Knowledge graphs (KGs), which capture vast amounts of facts in a structured format, offer a reliable source of knowledge for reasoning. Nevertheless, existing KG-based LLM reasoning methods only treat KGs as factual knowledge bases and overlook the importance of their structural information for reasoning. In this paper, we propose a novel method called reasoning on graphs (RoG) that synergizes LLMs with KGs to enable faithful and interpretable reasoning. Specifically, we present a planning-retrieval-reasoning framework, where RoG first generates relation paths grounded by KGs as faithful plans. These plans are then used to retrieve valid reasoning paths from the KGs for LLMs to conduct faithful reasoning. Furthermore, RoG not only distills knowledge from KGs to improve the reasoning ability of LLMs through training but also allows seamless integration with any arbitrary LLMs during inference. Extensive experiments on two benchmark KGQA datasets demonstrate that RoG achieves state-of-the-art performance on KG reasoning tasks and generates faithful and interpretable reasoning results.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

The paper primarily aims to address two key issues in the reasoning process of large language models (LLMs):

1. **Lack of Up-to-date Knowledge**: LLMs lack the latest knowledge updates, which can lead to errors during reasoning.
2. **Hallucination Problem**: LLMs are prone to hallucinations during reasoning, generating incorrect reasoning steps.

To solve these problems, the paper proposes a new method called "Reasoning over Graphs (RoG)," which combines the advantages of knowledge graphs (KGs) and LLMs. Specifically, RoG adopts a plan-retrieve-reason framework:
- **Planning Module**: Generates relation paths based on KGs as reliable plans.
- **Retrieve-Reason Module**: Retrieves effective reasoning paths from KGs based on these plans and performs faithful and interpretable reasoning based on these paths.

In this way, RoG not only leverages the structural information in KGs to improve the reasoning capabilities of LLMs but also seamlessly integrates any LLMs for reasoning. Experimental results show that RoG achieves state-of-the-art performance on 2 benchmark knowledge graph question-answering datasets and generates faithful and interpretable reasoning results.