Abstract:Large language models (LLMs) have recently demonstrated remarkable performance across various Natual Language Processing tasks. In the field of multi-hop reasoning, the Chain-of-thought (CoT) prompt method has emerged as a paradigm, using curated stepwise reasoning demonstrations to enhance LLM's ability to reason and produce coherent rational pathways. To ensure the accuracy, reliability, and traceability of the generated answers, many studies have incorporated information retrieval (IR) to provide LLMs with external knowledge. However, existing CoT with IR methods decomposes questions into sub-questions based on a single compositionality type, which limits their effectiveness for questions involving multiple compositionality types. Additionally, these methods suffer from inefficient retrieval, as complex questions often contain abundant information, leading to the retrieval of irrelevant information inconsistent with the query's intent. In this work, we propose a novel question decomposition framework called TRQA for multi-hop question answering, which addresses these limitations. Our framework introduces a reasoning tree (RT) to represent the structure of complex questions. It consists of four components: the Reasoning Tree Constructor (RTC), the Question Generator (QG), the Retrieval and LLM Interaction Module (RAIL), and the Answer Aggregation Module (AAM). Specifically, the RTC predicts diverse sub-question structures to construct the reasoning tree, allowing a more comprehensive representation of complex questions. The QG generates sub-questions for leaf-node in the reasoning tree, and we explore two methods for QG: prompt-based and T5-based approaches. The IR module retrieves documents aligned with sub-questions, while the LLM formulates answers based on the retrieved information. Finally, the AAM aggregates answers along the reason tree, producing a definitive response from bottom to top.

Enhancing the Completeness of Rationales for Multi-Step Question Answering

Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable

Tree-of-Reasoning Question Decomposition for Complex Question Answering with Large Language Models

A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models

Answering Questions by Meta-Reasoning over Multiple Chains of Thought

Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning

Locate then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering

Dual-Channel Reasoning Model for Complex Question Answering

Towards A Unified View of Answer Calibration for Multi-Step Reasoning

Explore Multi-Step Reasoning in Video Question Answering

Question Decomposition Tree for Answering Complex Questions over Knowledge Bases

Coarse-grained decomposition and fine-grained interaction for multi-hop question answering

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning

Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrieval

Generating Multi-hop Reasoning Questions to Improve Machine Reading Comprehension.

CoQ:AN Empirical Framework for Multi-hop Question Answering Empowered by Large Language Models

AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition

Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering

PathReasoner: Explainable Reasoning Paths for Commonsense Question Answering

Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering

Ask to Understand: Question Generation for Multi-hop Question Answering