Abstract:Large language models (LLMs) have recently demonstrated remarkable performance across various Natual Language Processing tasks. In the field of multi-hop reasoning, the Chain-of-thought (CoT) prompt method has emerged as a paradigm, using curated stepwise reasoning demonstrations to enhance LLM's ability to reason and produce coherent rational pathways. To ensure the accuracy, reliability, and traceability of the generated answers, many studies have incorporated information retrieval (IR) to provide LLMs with external knowledge. However, existing CoT with IR methods decomposes questions into sub-questions based on a single compositionality type, which limits their effectiveness for questions involving multiple compositionality types. Additionally, these methods suffer from inefficient retrieval, as complex questions often contain abundant information, leading to the retrieval of irrelevant information inconsistent with the query's intent. In this work, we propose a novel question decomposition framework called TRQA for multi-hop question answering, which addresses these limitations. Our framework introduces a reasoning tree (RT) to represent the structure of complex questions. It consists of four components: the Reasoning Tree Constructor (RTC), the Question Generator (QG), the Retrieval and LLM Interaction Module (RAIL), and the Answer Aggregation Module (AAM). Specifically, the RTC predicts diverse sub-question structures to construct the reasoning tree, allowing a more comprehensive representation of complex questions. The QG generates sub-questions for leaf-node in the reasoning tree, and we explore two methods for QG: prompt-based and T5-based approaches. The IR module retrieves documents aligned with sub-questions, while the LLM formulates answers based on the retrieved information. Finally, the AAM aggregates answers along the reason tree, producing a definitive response from bottom to top.

Complex Question Decomposition for Semantic Parsing

Semantic Parsing Using Hierarchical Concept Base.

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

A Decomposition Method for Complex Factoid Questions Based on Dependency Parsing

Bridging the Gap Between Synthetic and Natural Questions Via Sentence Decomposition for Semantic Parsing

Deep Hierarchical Human Semantic Parsing

A Transition-based Method for Complex Question Understanding.

Overcoming Language Priors In Vqa Via Decomposed Linguistic Representations

Semantic Decomposition of Question and SQL for Text-to-SQL Parsing

Question Decomposition Tree for Answering Complex Questions over Knowledge Bases

Semantic Parsing for Question Answering over Knowledge Graphs

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

Hierarchical Human Semantic Parsing With Comprehensive Part-Relation Modeling

Query Understanding Enhanced by Hierarchical Parsing Structures

Hierarchical Human Parsing with Typed Part-Relation Reasoning

Tree-of-Reasoning Question Decomposition for Complex Question Answering with Large Language Models

Program Transfer and Ontology Awareness for Semantic Parsing in KBQA

A Survey on Semantic Parsing from the perspective of Compositionality

Question Answering via Phrasal Semantic Parsing

A Semantic Parsing Pipeline for Context-Dependent Question Answering over Temporally Structured Data

Improving Complex Knowledge Base Question Answering Via Structural Information Learning