Abstract:Chain-of-Thought (CoT) prompting and its variants have gained popularity as effective methods for solving multi-step reasoning problems using pretrained large language models (LLMs). In this work, we analyze CoT prompting from a statistical estimation perspective, providing a comprehensive characterization of its sample complexity. To this end, we introduce a multi-step latent variable model that encapsulates the reasoning process, where the latent variable encodes the task information. Under this framework, we demonstrate that when the pretraining dataset is sufficiently large, the estimator formed by CoT prompting is equivalent to a Bayesian estimator. This estimator effectively solves the multi-step reasoning problem by aggregating a posterior distribution inferred from the demonstration examples in the prompt. Moreover, we prove that the statistical error of the CoT estimator can be decomposed into two main components: (i) a prompting error, which arises from inferring the true task using CoT prompts, and (ii) the statistical error of the pretrained LLM. We establish that, under appropriate assumptions, the prompting error decays exponentially to zero as the number of demonstrations increases. Additionally, we explicitly characterize the approximation and generalization errors of the pretrained LLM. Notably, we construct a transformer model that approximates the target distribution of the multi-step reasoning problem with an error that decreases exponentially in the number of transformer blocks. Our analysis extends to other variants of CoT, including Self-Consistent CoT, Tree-of-Thought, and Selection-Inference, offering a broad perspective on the efficacy of these methods. We also provide numerical experiments to validate the theoretical findings.

Tab-CoT: Zero-shot Tabular Chain of Thought

To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning

Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters

Supervised Chain of Thought

A Hopfieldian View-based Interpretation for Chain-of-Thought Reasoning

A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration

Chain of Thoughtlessness? An Analysis of CoT in Planning

Instance-adaptive Zero-shot Chain-of-Thought Prompting

Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods

Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data

Chain-of-Thought Reasoning Without Prompting

On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning

Markov Chain of Thought for Efficient Mathematical Reasoning

Self-Harmonized Chain of Thought

DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models

Towards Better Chain-of-Thought Prompting Strategies: A Survey

ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting

Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning

Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Models

Chain-of-Probe: Examing the Necessity and Accuracy of CoT Step-by-Step