Abstract:Large language models (LLMs) have recently demonstrated remarkable performance across various Natual Language Processing tasks. In the field of multi-hop reasoning, the Chain-of-thought (CoT) prompt method has emerged as a paradigm, using curated stepwise reasoning demonstrations to enhance LLM's ability to reason and produce coherent rational pathways. To ensure the accuracy, reliability, and traceability of the generated answers, many studies have incorporated information retrieval (IR) to provide LLMs with external knowledge. However, existing CoT with IR methods decomposes questions into sub-questions based on a single compositionality type, which limits their effectiveness for questions involving multiple compositionality types. Additionally, these methods suffer from inefficient retrieval, as complex questions often contain abundant information, leading to the retrieval of irrelevant information inconsistent with the query's intent. In this work, we propose a novel question decomposition framework called TRQA for multi-hop question answering, which addresses these limitations. Our framework introduces a reasoning tree (RT) to represent the structure of complex questions. It consists of four components: the Reasoning Tree Constructor (RTC), the Question Generator (QG), the Retrieval and LLM Interaction Module (RAIL), and the Answer Aggregation Module (AAM). Specifically, the RTC predicts diverse sub-question structures to construct the reasoning tree, allowing a more comprehensive representation of complex questions. The QG generates sub-questions for leaf-node in the reasoning tree, and we explore two methods for QG: prompt-based and T5-based approaches. The IR module retrieves documents aligned with sub-questions, while the LLM formulates answers based on the retrieved information. Finally, the AAM aggregates answers along the reason tree, producing a definitive response from bottom to top.

CoQ:AN Empirical Framework for Multi-hop Question Answering Empowered by Large Language Models

Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering

KG-CoT: Chain-of-Thought Prompting of Large Language Models over Knowledge Graphs for Knowledge-Aware Question Answering

Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models

Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning

Tree-of-Reasoning Question Decomposition for Complex Question Answering with Large Language Models

Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning

Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Action

Chain-of-Discussion: A Multi-Model Framework for Complex Evidence-Based Question Answering

keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLM

Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions

A Framework of Knowledge Graph-Enhanced Large Language Model Based on Question Decomposition and Atomic Retrieval

A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models

Multimodal Chain-of-Thought Reasoning in Language Models

Cofca: A Step-Wise Counterfactual Multi-hop QA benchmark

T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning Via Large Language Model Signals for Science Question Answering.

UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models

CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks

Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources

EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs

CoG-DQA: Chain-of-Guiding Learning with Large Language Models for Diagram Question Answering