Abstract:As Large Language Models (LLMs) scale up and gain powerful Chain-of-Thoughts (CoTs) reasoning abilities, practical resource constraints drive efforts to distill these capabilities into more compact Smaller Language Models (SLMs). We find that CoTs consist mainly of simple reasoning forms, with a small proportion ($\approx 4.7\%$) of key reasoning steps that truly impact conclusions. However, previous distillation methods typically involve supervised fine-tuning student SLMs only on correct CoTs data produced by teacher LLMs, resulting in students struggling to learn the key reasoning steps, instead imitating the teacher's reasoning forms and making errors or omissions on these steps. To address these issues, drawing an analogy to human learning, where analyzing mistakes according to correct solutions often reveals the crucial steps leading to successes or failures, we propose mistak\textbf{E}-\textbf{D}riven key reason\textbf{I}ng step distilla\textbf{T}ion (\textbf{EDIT}), a novel method that further aids SLMs learning key reasoning steps rather than mere simple fine-tuning. Firstly, to expose these crucial steps in CoTs, we design specific prompts to generate dual CoTs data with similar reasoning paths but divergent conclusions. Then, we apply the minimum edit distance algorithm on the dual CoTs data to locate these key steps and optimize the likelihood of these steps. Extensive experiments validate the effectiveness of EDIT across both in-domain and out-of-domain benchmark reasoning datasets. Further analysis shows that EDIT can generate high-quality CoTs with more correct key reasoning steps. Notably, we also explore how different mistake patterns affect performance and find that EDIT benefits more from logical errors than from knowledge or mathematical calculation errors in dual CoTs\footnote{Code can be found at \url{<a class="link-external link-https" href="https://github.com/C-W-D/EDIT" rel="external noopener nofollow">this https URL</a>}}.

Intuitionistic Entropy-Induced Cooperative Symmetric Implicational Inference

Entropy-Based Symmetric Implicational Method for R-and (S,N)-Implications

Symmetric implicational algorithm derived from intuitionistic fuzzy entropy

An Improved Belief Entropy and Its Application in Decision-Making

Symmetric Implicational Restriction Method of Fuzzy Inference

Variable Differently Implicational Inference for R- and S-Implications

On Interdisciplinary Studies of a New Generation of Artificial Intelligence and Logic

When Do Program-of-Thought Works for Reasoning?

A Novel Plausible Reasoning Based on Intuitionistic Fuzzy Propositional Logic and Its Application in Decision Making.

Granular Symmetric Implicational Method

An Inductive Reasoning Model based on Interpretable Logical Rules over temporal knowledge graph

Variable differently implicational algorithm of fuzzy inference.

Inductive Coherence

Investigations of T -power based implications satisfying some functional equations related to reasoning schemes

Fuzzy inference with fuzzy implications satisfying generalized hypothetical syllogism

Coherence in Intelligent Systems.

A unified algorithm for finding $$k$$ k -IESFs in linguistic truth-valued lattice-valued propositional logic.

Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation

A New Procedure to Intuitionistic Uncertain Linguistic Group Decision Making.

Optimal Cooperative Inference

INFORM : Information Entropy Based Multi-Step Reasoning FOR Large Language Models