Abstract:Large language models (LLMs) have recently demonstrated remarkable performance across various Natual Language Processing tasks. In the field of multi-hop reasoning, the Chain-of-thought (CoT) prompt method has emerged as a paradigm, using curated stepwise reasoning demonstrations to enhance LLM's ability to reason and produce coherent rational pathways. To ensure the accuracy, reliability, and traceability of the generated answers, many studies have incorporated information retrieval (IR) to provide LLMs with external knowledge. However, existing CoT with IR methods decomposes questions into sub-questions based on a single compositionality type, which limits their effectiveness for questions involving multiple compositionality types. Additionally, these methods suffer from inefficient retrieval, as complex questions often contain abundant information, leading to the retrieval of irrelevant information inconsistent with the query's intent. In this work, we propose a novel question decomposition framework called TRQA for multi-hop question answering, which addresses these limitations. Our framework introduces a reasoning tree (RT) to represent the structure of complex questions. It consists of four components: the Reasoning Tree Constructor (RTC), the Question Generator (QG), the Retrieval and LLM Interaction Module (RAIL), and the Answer Aggregation Module (AAM). Specifically, the RTC predicts diverse sub-question structures to construct the reasoning tree, allowing a more comprehensive representation of complex questions. The QG generates sub-questions for leaf-node in the reasoning tree, and we explore two methods for QG: prompt-based and T5-based approaches. The IR module retrieves documents aligned with sub-questions, while the LLM formulates answers based on the retrieved information. Finally, the AAM aggregates answers along the reason tree, producing a definitive response from bottom to top.

Immunosuppressive activity of isolated rat and human fetoproteins.

Compositional Substitutivity of Visual Reasoning for Visual Question Answering

Graph Reasoning Networks for Visual Question Answering

Linguistically Driven Graph Capsule Network for Visual Question Reasoning

From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering

An Interpretable Reasoning Network for Multi-Relation Question Answering.

Question-relationship guided graph attention network for visual question answer

Scene Graph Refinement Network for Visual Question Answering

Learning to Compose and Reason with Language Tree Structures for Visual Grounding.

A Symbolic-Neural Reasoning Model for Visual Question Answering

Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering

Interpretable Visual Question Answering via Reasoning Supervision

Syntax Tree Constrained Graph Network for Visual Question Answering

Perceptual Visual Reasoning with Knowledge Propagation

In vitro formation of crystalline apatite by matrix vesicles isolated from rachitic rat epiphyseal cartilage.

Joint Answering and Explanation for Visual Commonsense Reasoning

Learning to Assemble Neural Module Tree Networks for Visual Grounding.

A Spatial Hierarchical Reasoning Network for Remote Sensing Visual Question Answering

Joint Learning of Object Graph and Relation Graph for Visual Question Answering

Tree-of-Reasoning Question Decomposition for Complex Question Answering with Large Language Models

Toward Accurate Visual Reasoning with Dual-Path Neural Module Networks.