Why Can Large Language Models Generate Correct Chain-of-Thoughts?

Rasul Tutunov,Antoine Grosnit,Juliusz Ziomek,Jun Wang,Haitham Bou-Ammar

2024-06-06

Abstract:This paper delves into the capabilities of large language models (LLMs), specifically focusing on advancing the theoretical comprehension of chain-of-thought prompting. We investigate how LLMs can be effectively induced to generate a coherent chain of thoughts. To achieve this, we introduce a two-level hierarchical graphical model tailored for natural language generation. Within this framework, we establish a compelling geometrical convergence rate that gauges the likelihood of an LLM-generated chain of thoughts compared to those originating from the true language. Our findings provide a theoretical justification for the ability of LLMs to produce the correct sequence of thoughts (potentially) explaining performance gains in tasks demanding reasoning skills.

Computation and Language

What problem does this paper attempt to address?

The problem this paper attempts to address is understanding why large language models (LLMs) are able to generate correct chains of thought (CoT). Specifically, the authors focus on how theoretical analysis can explain the ability of LLMs to generate coherent and reasonable intermediate reasoning steps when handling tasks that require reasoning through appropriate prompting. The main contributions of the paper include: 1. **Proposing a two-layer hierarchical graph model**: To achieve this goal, the authors introduce a two-layer hierarchical graph model for natural language generation. This model can evaluate the differences between the chains of thought generated by LLMs and those produced by real language. 2. **Geometric convergence rate**: Within this framework, the authors establish a geometric convergence rate to measure the similarity between the chains of thought generated by LLMs and those produced by real language. 3. **Theoretical explanation**: These findings provide a theoretical basis to explain why LLMs perform well in tasks that require reasoning and how generating correct chains of thought can enhance performance. Overall, the paper aims to reveal the performance mechanisms of LLMs in handling complex reasoning tasks through theoretical analysis, particularly in their ability to generate intermediate reasoning steps.

Why Can Large Language Models Generate Correct Chain-of-Thoughts?

Concise and Organized Perception Facilitates Large Language Models for Deductive Reasoning.

Chain-of-Thought in Large Language Models: Decoding, Projection, and Activation

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Supervised Chain of Thought

General Purpose Verification for Chain of Thought Prompting

Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought

Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance

Towards Faithful Chain-of-Thought: Large Language Models are Bridging Reasoners

Psychologically-informed chain-of-thought prompts for metaphor understanding in large language models

Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought

Larger Language Models Don't Care How You Think: Why Chain-of-Thought Prompting Fails in Subjective Tasks

ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting

On the Hardness of Faithful Chain-of-Thought Reasoning in Large Language Models

Integrating Large Language Models and Reinforcement Learning for Non-Linear Reasoning

What Makes Large Language Models Reason in (Multi-Turn) Code Generation?

Multimodal Chain-of-Thought Reasoning in Language Models

Reasoning with Large Language Models, a Survey

Thought-Like-Pro: Enhancing Reasoning of Large Language Models through Self-Driven Prolog-based Chain-of-Thought