Abstract:Knowledge Graph Question Answering (KGQA) methods seek to answer Natural Language questions using the relational information stored in Knowledge Graphs (KGs). With the recent advancements of Large Language Models (LLMs) and their remarkable reasoning abilities, there is a growing trend to leverage them for KGQA. However, existing methodologies have only focused on answering factual questions, e.g., "In which city was Silvio Berlusconi's first wife born?", leaving questions involving commonsense reasoning that real-world users may pose more often, e.g., "Do I need separate visas to see the Venus of Willendorf and attend the Olympics this summer?" unaddressed. In this work, we first observe that existing LLM-based methods for KGQA struggle with hallucination on such questions, especially on queries targeting long-tail entities (e.g., non-mainstream and recent entities), thus hindering their applicability in real-world applications especially since their reasoning processes are not easily verifiable. In response, we propose Right for Right Reasons (R3), a commonsense KGQA methodology that allows for a verifiable reasoning procedure by axiomatically surfacing intrinsic commonsense knowledge of LLMs and grounding every factual reasoning step on KG triples. Through experimental evaluations across three different tasks--question answering, claim verification, and preference matching--our findings showcase R3 as a superior approach, outperforming existing methodologies and notably reducing instances of hallucination and reasoning errors.

Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion

Leveraging Non-Parametric Reasoning with Large Language Models for Enhanced Knowledge Graph Completion

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

A Principled Framework for Knowledge-enhanced Large Language Model

Chain-of-Knowledge: Integrating Knowledge Reasoning into Large Language Models by Learning from Knowledge Graphs

Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data

Can Language Models Act as Knowledge Bases at Scale?

Large Language Models can Learn Rules

Exploring Large Language Models for Knowledge Graph Completion

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning

CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge

Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering

Enhancing Large Language Models with Knowledge Graphs for Robust Question Answering

KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph

Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering

Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs

Knowledge Graph-Enhanced Large Language Models via Path Selection

A Framework of Knowledge Graph-Enhanced Large Language Model Based on Question Decomposition and Atomic Retrieval

Making Large Language Models Perform Better in Knowledge Graph Completion