Abstract:Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic facts. Consequently, integrating LLMs with knowledge graphs has been extensively explored, with Knowledge Graph Question Answering (KGQA) serving as a critical touchstone for the integration. This task requires LLMs to answer natural language questions by retrieving relevant triples from knowledge graphs. However, existing methods face two significant challenges: \textit{excessively long reasoning paths distracting from the answer generation}, and \textit{false-positive relations hindering the path refinement}. In this paper, we propose an iterative interactive KGQA framework that leverages the interactive learning capabilities of LLMs to perform reasoning and Debating over Graphs (DoG). Specifically, DoG employs a subgraph-focusing mechanism, allowing LLMs to perform answer trying after each reasoning step, thereby mitigating the impact of lengthy reasoning paths. On the other hand, DoG utilizes a multi-role debate team to gradually simplify complex questions, reducing the influence of false-positive relations. This debate mechanism ensures the reliability of the reasoning process. Experimental results on five public datasets demonstrate the effectiveness and superiority of our architecture. Notably, DoG outperforms the state-of-the-art method ToG by 23.7\% and 9.1\% in accuracy on WebQuestions and GrailQA, respectively. Furthermore, the integration experiments with various LLMs on the mentioned datasets highlight the flexibility of DoG. Code is available at \url{<a class="link-external link-https" href="https://github.com/reml-group/DoG" rel="external noopener nofollow">this https URL</a>}.

A Picture Is Worth a Graph: A Blueprint Debate Paradigm for Multimodal Reasoning

Argumentation-Based Non-Monotonic Reasoning of Agents

Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Models

Improving Multi-Agent Debate with Sparse Communication Topology

Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate

Learning to Break: Knowledge-Enhanced Reasoning in Multi-Agent Debate System

A User Interface for Sense-making of the Reasoning Process while Interacting with Robots

When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks

Reasoning with Multi-Structure Commonsense Knowledge in Visual Dialog

Two Heads are Better Than One: Hypergraph-Enhanced Graph Reasoning for Visual Event Ratiocination

Multimodal Analogical Reasoning over Knowledge Graphs

Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation

DebateKG: Automatic Policy Debate Case Creation with Semantic Knowledge Graphs

Multi-Modal Dialogue State Tracking for Playing GuessWhich Game

MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models

Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model

Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models

Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation

Any Other Thoughts, Hedgehog? Linking Deliberation Chains in Collaborative Dialogues

VisionGraph: Leveraging Large Multimodal Models for Graph Theory Problems in Visual Context