Abstract:Large language models (LLMs) have dramatically enhanced the field of language intelligence, as demonstrably evidenced by their formidable empirical performance across a spectrum of complex reasoning tasks. Additionally, theoretical proofs have illuminated their emergent reasoning capabilities, providing a compelling showcase of their advanced cognitive abilities in linguistic contexts. Critical to their remarkable efficacy in handling complex reasoning tasks, LLMs leverage the intriguing chain-of-thought (CoT) reasoning techniques, obliging them to formulate intermediate steps en route to deriving an answer. The CoT reasoning approach has not only exhibited proficiency in amplifying reasoning performance but also in enhancing interpretability, controllability, and flexibility. In light of these merits, recent research endeavors have extended CoT reasoning methodologies to nurture the development of autonomous language agents, which adeptly adhere to language instructions and execute actions within varied environments. This survey paper orchestrates a thorough discourse, penetrating vital research dimensions, encompassing: (i) the foundational mechanics of CoT techniques, with a focus on elucidating the circumstances and justification behind its efficacy; (ii) the paradigm shift in CoT; and (iii) the burgeoning of language agents fortified by CoT approaches. Prospective research avenues envelop explorations into generalization, efficiency, customization, scaling, and safety. This paper caters to a wide audience, including beginners seeking comprehensive knowledge of CoT reasoning and language agents, as well as experienced researchers interested in foundational mechanics and engaging in cutting-edge discussions on these topics. A repository for the related papers is available at <a class="link-external link-https" href="https://github.com/Zoeyyao27/CoT-Igniting-Agent" rel="external noopener nofollow">this https URL</a>.

Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future

When Do Program-of-Thought Works for Reasoning?

A Survey of Reasoning with Foundation Models

Understanding Reasoning in Chain-of-Thought from the Hopfieldian View

Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents

When Do Program-of-Thoughts Work for Reasoning?

Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought

Unlocking the Boundaries of Thought: A Reasoning Granularity Framework to Quantify and Optimize Chain-of-Thought

Towards Better Chain-of-Thought Prompting Strategies: A Survey

Eliminating Reasoning via Inferring with Planning: A New Framework to Guide LLMs' Non-linear Thinking

Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation

Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs

Demystifying Chains, Trees, and Graphs of Thoughts

Thought Space Explorer: Navigating and Expanding Thought Space for Large Language Model Reasoning

The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task

Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters

Chain of Thoughtlessness? An Analysis of CoT in Planning

On the Empirical Complexity of Reasoning and Planning in LLMs

Generating Chain-of-Thoughts with a Pairwise-Comparison Approach to Searching for the Most Promising Intermediate Thought

Supervised Chain of Thought

Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data