Abstract:In enhancing the reasoning capabilities of large language models (LLMs), prior research primarily focuses on specific prompting techniques such as few-shot or zero-shot chain-of-thought (CoT) prompting. These methods, while effective, often involve manually intensive prompt engineering. Our study takes a novel approach by asking: Can LLMs reason effectively without prompting? Our findings reveal that, intriguingly, CoT reasoning paths can be elicited from pre-trained LLMs by simply altering the \textit{decoding} process. Rather than conventional greedy decoding, we investigate the top-$k$ alternative tokens, uncovering that CoT paths are frequently inherent in these sequences. This approach not only bypasses the confounders of prompting but also allows us to assess the LLMs' \textit{intrinsic} reasoning abilities. Moreover, we observe that the presence of a CoT in the decoding path correlates with a higher confidence in the model's decoded answer. This confidence metric effectively differentiates between CoT and non-CoT paths. Extensive empirical studies on various reasoning benchmarks show that the proposed CoT-decoding effectively elicits reasoning capabilities from language models, which were previously obscured by standard greedy decoding.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper attempts to address the issue of large language models (LLMs) relying on prompting techniques for reasoning tasks. Traditionally, to enhance the reasoning capabilities of LLMs, researchers have focused on specific prompting techniques, such as few-shot or zero-shot Chain-of-Thought (CoT) prompting. While these methods are effective, they often require cumbersome manual prompt engineering. The core question posed by the paper is: **Can large language models effectively perform reasoning without prompts?** Specifically, the authors explore the following points: 1. **Prompt-free reasoning**: Can effective Chain-of-Thought paths be extracted from pre-trained LLMs by simply modifying the decoding process? 2. **Intrinsic reasoning ability**: Do LLMs possess intrinsic reasoning abilities that are masked during standard greedy decoding? 3. **Confidence assessment**: Is the Chain-of-Thought path generated during the decoding process related to the model's confidence in the final answer? ### Main Findings 1. **Prompt-free Chain-of-Thought**: The authors found that by altering the decoding process, particularly by considering the top-𝑘 tokens, effective Chain-of-Thought paths can be extracted from pre-trained LLMs. This method not only bypasses the interference of prompts but also allows for the assessment of the model's intrinsic reasoning abilities. 2. **Confidence and Chain-of-Thought**: When a Chain-of-Thought path exists in the decoding path, the model's confidence in the final answer is generally higher. This phenomenon can be used to distinguish between Chain-of-Thought paths and non-Chain-of-Thought paths. 3. **Broad applicability**: In multiple reasoning benchmarks, the proposed Chain-of-Thought decoding method (CoT-decoding) significantly improved the model's reasoning capabilities, especially in mathematical and commonsense reasoning tasks. ### Experimental Results - **Comparison of different decoding strategies**: In multiple benchmarks, CoT-decoding was the only decoding strategy that significantly enhanced the model's reasoning capabilities. - **Effect across different model scales**: CoT-decoding performed well across different model scales, sometimes even doubling or tripling performance. - **Comparison with instruction-tuned models**: CoT-decoding enabled pre-trained models to achieve performance close to that of instruction-tuned models, without the need for supervised data. ### Conclusion This paper demonstrates that by simply modifying the decoding process, effective Chain-of-Thought paths can be extracted from pre-trained LLMs, thereby enhancing their reasoning capabilities. This method not only bypasses the interference of prompts but also better assesses the model's intrinsic reasoning abilities. These findings challenge the existing literature's view that LLMs cannot effectively reason without prompts and provide new directions for future research.

Chain-of-Thought Reasoning Without Prompting

Chain-of-Thought Reasoning Without Prompting

Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters

Boosting Language Models Reasoning with Chain-of-Knowledge Prompting

Supervised Chain of Thought

ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting

Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Automatic Chain of Thought Prompting in Large Language Models

Deciphering the Factors Influencing the Efficacy of Chain-of-Thought: Probability, Memorization, and Noisy Reasoning

Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models

Pattern-Aware Chain-of-Thought Prompting in Large Language Models

DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models

Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning

An automatically discovered chain-of-thought prompt generalizes to novel models and datasets

Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding

Latent Skill Discovery for Chain-of-Thought Reasoning

Instance-adaptive Zero-shot Chain-of-Thought Prompting

R$^3$ Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context