Abstract:This paper presents a critical examination of current approaches to replicating OpenAI's O1 model capabilities, with particular focus on the widespread but often undisclosed use of knowledge distillation techniques. While our previous work explored the fundamental technical path to O1 replication, this study reveals how simple distillation from O1's API, combined with supervised fine-tuning, can achieve superior performance on complex mathematical reasoning tasks. Through extensive experiments, we show that a base model fine-tuned on simply tens of thousands of samples O1-distilled long-thought chains outperforms O1-preview on the American Invitational Mathematics Examination (AIME) with minimal technical complexity. Moreover, our investigation extends beyond mathematical reasoning to explore the generalization capabilities of O1-distilled models across diverse tasks: hallucination, safety and open-domain QA. Notably, despite training only on mathematical problem-solving data, our models demonstrated strong generalization to open-ended QA tasks and became significantly less susceptible to sycophancy after fine-tuning. We deliberately make this finding public to promote transparency in AI research and to challenge the current trend of obscured technical claims in the field. Our work includes: (1) A detailed technical exposition of the distillation process and its effectiveness, (2) A comprehensive benchmark framework for evaluating and categorizing O1 replication attempts based on their technical transparency and reproducibility, (3) A critical discussion of the limitations and potential risks of over-relying on distillation approaches, our analysis culminates in a crucial bitter lesson: while the pursuit of more capable AI systems is important, the development of researchers grounded in first-principles thinking is paramount.

The Blessings of Multiple Causes: A Reply to Ogburn et al. (2019)

Discussion of "The Blessings of Multiple Causes" by Wang and Blei

The Influence of Open Access on the Academic Purification Effect of Retracted Publications: A Causal Inference Analysis

Altruism or Social Motives? Evidence from Online Charitable Giving in China.

On some recent developments in Kähler geometry

Refutations on "Debunking the Myths of Influence Maximization: An In-Depth Benchmarking Study"

The Promises of Parallel Outcomes

A response to a critique of "A novel electronic cash system with trustee-based anonymity revocation from pairing," by Chen, Chou, Sun and Cho (2011)

O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?

Rejoinder on Causal Inference Through Potential Outcomes and Principal Stratification: Application to Studies with ``Censoring'' Due to Death by D. B. Rubin

The Blessings of Multiple Treatments and Outcomes in Treatment Effect Estimation

A Reply to Makelov et al. (2023)'s "Interpretability Illusion" Arguments

Effects of Causes and Causes of Effects

Discussion of "On the Birnbaum Argument for the Strong Likelihood Principle"

Multi-cause Discrimination Analysis Using Potential Outcomes.

All Claims in the Original Article Hold As Stated

Response to von Schmalensee et al.

Is the open access citation advantage real? A systematic review of the citation of open access and subscription-based articles

Discussion: On Arguments Concerning Statistical Principles

Reply to Delanghe et al, Boudin et al, and Focosi et al

The persistence of wishful thinking: Response to "Updated thinking on positivity ratios"