Conditional and Modal Reasoning in Large Language Models

Wesley H. Holliday,Matthew Mandelkern,Cedegao E. Zhang

2024-10-13

Abstract:The reasoning abilities of large language models (LLMs) are the topic of a growing body of research in AI and cognitive science. In this paper, we probe the extent to which twenty-nine LLMs are able to distinguish logically correct inferences from logically fallacious ones. We focus on inference patterns involving conditionals (e.g., 'If Ann has a queen, then Bob has a jack') and epistemic modals (e.g., 'Ann might have an ace', 'Bob must have a king'). These inferences have been of special interest to logicians, philosophers, and linguists, since they play a central role in the fundamental human ability to reason about distal possibilities. Assessing LLMs on these inferences is thus highly relevant to the question of how much the reasoning abilities of LLMs match those of humans. All the LLMs we tested make some basic mistakes with conditionals or modals, though zero-shot chain-of-thought prompting helps them make fewer mistakes. Even the best performing LLMs make basic errors in modal reasoning, display logically inconsistent judgments across inference patterns involving epistemic modals and conditionals, and give answers about complex conditional inferences that do not match reported human judgments. These results highlight gaps in basic logical reasoning in today's LLMs.

Computation and Language,Artificial Intelligence,Logic in Computer Science

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to evaluate the capabilities of large - language models (LLMs) in conditional reasoning and modal reasoning. Specifically, the authors focus on whether these models can distinguish between logically correct inferences and logical fallacies. They explore this issue by testing the recognition abilities of 29 different LLMs for reasoning patterns involving conditional sentences (for example, "If Ann has a Queen, then Bob has a Jack") and modal verbs (for example, "Ann may have an Ace", "Bob must have a King"). This type of reasoning is crucial for basic human cognitive abilities because it involves thinking about remote possibilities, which is very important for planning, causal reasoning, etc.

The main contributions of the paper include:
- Emphasizing the importance and nuances of conditional and modal reasoning and elaborating on them based on the latest evidence and theories in relevant literature.
- Proposing a new benchmark specifically designed to test the conditional and modal processing capabilities of LLMs in logical reasoning.
- Reporting the performance of a large number of LLMs under different prompt settings and identifying some of their deficiencies and undesirable behaviors in basic logical reasoning.

Through this study, the authors hope to reveal the current limitations of LLMs in logical reasoning and provide directions for further improving these models.