Abstract:Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can improve the reasoning ability of LLMs to some extent, they suffer from an unfaithful issue where derived conclusions may not align with the generated reasoning chain. To address this issue, some studies employ the approach of propositional logic to further enhance logical reasoning abilities of LLMs. However, the potential omissions in the extraction of logical expressions in these methods can cause information loss in the logical reasoning process, thereby generating incorrect results. To this end, we propose Logic-of-Thought (LoT) prompting which employs propositional logic to generate expanded logical information from input context, and utilizes the generated logical information as an additional augmentation to the input prompts, thereby enhancing the capability of logical reasoning. The LoT is orthogonal to existing prompting methods and can be seamlessly integrated with them. Extensive experiments demonstrate that LoT boosts the performance of various prompting methods with a striking margin across five logical reasoning tasks. In particular, the LoT enhances Chain-of-Thought's performance on the ReClor dataset by +4.35%; moreover, it improves Chain-of-Thought with Self-Consistency's performance on LogiQA by +5%; additionally, it boosts performance of Tree-of-Thoughts on ProofWriter dataset by +8%.

Large Language Models Perform Diagnostic Reasoning

Concise and Organized Perception Facilitates Large Language Models for Deductive Reasoning.

Large Language Models are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales

Diagnostic reasoning prompts reveal the potential for large language model interpretability in medicine

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Large Language Models as Analogical Reasoners

DiReCT: Diagnostic Reasoning for Clinical Notes via Large Language Models

Can large language models reason about medical questions?

Chain-of-Thought Reasoning Without Prompting

Advances in reasoning by prompting large language models: A survey

Reasoning with Large Language Models, a Survey

Multimodal Chain-of-Thought Reasoning in Language Models

The Impact of Reasoning Step Length on Large Language Models

Think Beyond Size: Adaptive Prompting for More Effective Reasoning

Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases

Large Language Models as an Indirect Reasoner: Contrapositive and Contradiction for Automated Reasoning

DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models

Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models