Abstract:Machine reading comprehension has aroused wide concerns, since it explores the potential of model for text understanding. To further equip the machine with the reasoning capability, the challenging task of logical reasoning is proposed. Previous works on logical reasoning have proposed some strategies to extract the logical units from different aspects. However, there still remains a challenge to model the long distance dependency among the logical units. Also, it is demanding to uncover the logical structures of the text and further fuse the discrete logic to the continuous text embedding. To tackle the above issues, we propose an end-to-end model Logiformer which utilizes a two-branch graph transformer network for logical reasoning of text. Firstly, we introduce different extraction strategies to split the text into two sets of logical units, and construct the logical graph and the syntax graph respectively. The logical graph models the causal relations for the logical branch while the syntax graph captures the co-occurrence relations for the syntax branch. Secondly, to model the long distance dependency, the node sequence from each graph is fed into the fully connected graph transformer structures. The two adjacent matrices are viewed as the attention biases for the graph transformer layers, which map the discrete logical structures to the continuous text embedding space. Thirdly, a dynamic gate mechanism and a question-aware self-attention module are introduced before the answer prediction to update the features. The reasoning process provides the interpretability by employing the logical units, which are consistent with human cognition. The experimental results show the superiority of our model, which outperforms the state-of-the-art single model on two logical reasoning benchmarks.

MuLoR: a multi-graph contrastive network for logical reasoning

LoCSGN: Logic-Contrast Semantic Graph Network for Machine Reading Comprehension

AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension

Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning

MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure

CLOMO: Counterfactual Logical Modification with Large Language Models

Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models

MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning

Are LLMs Rigorous Logical Reasoner? Empowering Natural Language Proof Generation with Contrastive Stepwise Decoding

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text

GraphLLM: Boosting Graph Reasoning Ability of Large Language Model

GLoRE: Evaluating Logical Reasoning of Large Language Models

LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts

Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge Graphs

Verb-driven machine reading comprehension with dual-graph neural network

Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models

DAGN: Discourse-Aware Graph Network for Logical Reasoning

Discourse-Aware Graph Networks for Textual Logical Reasoning

LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning

CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge

Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs