Abstract:In math reasoning with large language models (LLMs), fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective, profoundly narrowing the gap between open-sourced LLMs and cutting-edge proprietary LLMs. In this paper, we conduct an investigation for such data augmentation in math reasoning and are intended to answer: (1) What strategies of data augmentation are more effective; (2) What is the scaling relationship between the amount of augmented data and model performance; and (3) Can data augmentation incentivize generalization to out-of-domain mathematical reasoning tasks? To this end, we create two new dataset AugGSM8K and AugMATH, by complicating and diversifying the queries and sampling multiple reasoning paths from GSM8K and MATH. We obtained a series of LLMs called MuggleMath by fine-tuning LLaMA models on AugGSM8K and AugMATH. MuggleMath substantially achieves new state-of-the-art on GSM8K and MATH. A log-linear relationship and a segmented log-linear are presented between MuggleMath's performance and the amount of augmented data on GSM8K and MATH, respectively. We also find that it is weak in out-of-domain math reasoning generalization from AugGSM8K to MATH and from AugMATH to GSM8K, which suggests that augmenting queries that cover a broader range of subjects is more beneficial for generalization. We release our codes and augmented data in <a class="link-external link-https" href="https://github.com/OFA-Sys/gsm8k-ScRel" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problems that this paper attempts to solve can be summarized as the following points: 1. **Effectiveness of data augmentation strategies**: Researchers want to explore which data augmentation strategies are more effective in mathematical reasoning tasks. This involves how to increase the quality and quantity of the dataset by querying evolved and diverse reasoning paths, thereby improving the performance of the model. 2. **Relationship between data volume and model performance**: Researchers hope to understand the relationship between the amount of data augmentation and model performance, especially whether this relationship follows a certain pattern (such as a log - linear relationship). This research is crucial for understanding how to improve model capabilities by increasing training data. 3. **Impact of data augmentation on generalization ability**: Researchers are also concerned about whether data augmentation can stimulate the generalization ability of the model on unseen mathematical reasoning tasks. Specifically, they explored whether data augmentation from one domain (such as GSM8K) can effectively improve performance in another domain (such as MATH). To answer these questions, researchers created two new datasets, AugGSM8K and AugMATH, and fine - tuned the open - source large - language model LLaMA based on these datasets, obtaining a series of models named MuggleMath. The experimental results show that MuggleMath has achieved new state - of - the - art performance on both the GSM8K and MATH datasets. In addition, the study found that there is a log - linear relationship between model performance and the amount of data augmentation, but the performance on different datasets varies. Finally, the study also found that although data augmentation can significantly improve the model's performance on specific datasets, its improvement on cross - dataset generalization ability is relatively limited, indicating that a wider range of mathematical topics needs to be covered during data augmentation to promote generalization.

MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning

MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning

An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning

MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations

WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct

Augmenting Math Word Problems via Iterative Question Composing

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

PersonaMath: Enhancing Math Reasoning through Persona-Driven Data Augmentation

Scaling Relationship on Learning Mathematical Reasoning with Large Language Models

Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On

We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?

A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges

LLM Reasoning Engine: Specialized Training for Enhanced Mathematical Reasoning

MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible Pipeline

Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist

CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models