Abstract:Combining large language models with logical reasoning enhances their capacity to address problems in a robust and reliable manner. Nevertheless, the intricate nature of logical reasoning poses challenges when gathering reliable data from the web to build comprehensive training datasets, subsequently affecting performance on downstream tasks. To address this, we introduce a novel logic-driven data augmentation approach, AMR-LDA. AMR-LDA converts the original text into an Abstract Meaning Representation (AMR) graph, a structured semantic representation that encapsulates the logical structure of the sentence, upon which operations are performed to generate logically modified AMR graphs. The modified AMR graphs are subsequently converted back into text to create augmented data. Notably, our methodology is architecture-agnostic and enhances both generative large language models, such as GPT-3.5 and GPT-4, through prompt augmentation, and discriminative large language models through contrastive learning with logic-driven data augmentation. Empirical evidence underscores the efficacy of our proposed method with improvement in performance across seven downstream tasks, such as reading comprehension requiring logical reasoning, textual entailment, and natural language inference. Furthermore, our method leads on the ReClor leaderboard at <a class="link-external link-https" href="https://eval.ai/web/challenges/challenge-page/503/leaderboard/1347" rel="external noopener nofollow">this https URL</a>. The source code and data are publicly available at <a class="link-external link-https" href="https://github.com/Strong-AI-Lab/Logical-Equivalence-driven-AMR-Data-Augmentation-for-Representation-Learning" rel="external noopener nofollow">this https URL</a>.

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text

Concise and Organized Perception Facilitates Large Language Models for Deductive Reasoning.

Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning

Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities

Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models

Reasoning Makes Good Annotators : an Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction

Thought-Path Contrastive Learning via Premise-Oriented Data Augmentation for Logical Reading Comprehension

Discourse-Aware Graph Networks for Textual Logical Reasoning

Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning

PathReasoner: Modeling Reasoning Path with Equivalent Extension for Logical Question Answering

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension

Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding

Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic

When Do Program-of-Thought Works for Reasoning?

Information Re-Organization Improves Reasoning in Large Language Models

Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic

LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning

Enhancing Logical Reasoning in Large Language Models through Graph-based Synthetic Data

MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure