Abstract:Solving mathematical problems requires advanced reasoning abilities and presents notable challenges for large language models. Previous works usually synthesize data from proprietary models to augment existing datasets, followed by instruction tuning to achieve top-tier results. However, our analysis of these datasets reveals severe biases towards easy queries, with frequent failures to generate any correct response for the most challenging queries. Hypothesizing that difficult queries are crucial to learn complex reasoning, we propose Difficulty-Aware Rejection Tuning (DART), a method that allocates difficult queries more trials during the synthesis phase, enabling more extensive training on difficult samples. Utilizing DART, we have created new datasets for mathematical problem-solving that focus more on difficult queries and are substantially smaller than previous ones. Remarkably, our synthesis process solely relies on a 7B-sized open-weight model, without reliance on the commonly used proprietary GPT-4. We fine-tune various base models on our datasets ranging from 7B to 70B in size, resulting in a series of strong models called DART-MATH. In comprehensive in-domain and out-of-domain evaluation on 6 mathematical benchmarks, DART-MATH outperforms vanilla rejection tuning significantly, being superior or comparable to previous arts, despite using much smaller datasets and no proprietary models. Furthermore, our results position our synthetic datasets as the most effective and cost-efficient publicly available resources for advancing mathematical problem-solving.

RODA: Reverse Operation Based Data Augmentation for Solving Math Word Problems

Semantic-Based Data Augmentation for Math Word Problems

Data Augmentation with In-Context Learning and Comparative Evaluation in Math Word Problem Solving

MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

ControlMath: Controllable Data Generation Promotes Math Generalist Models

Deep Learning in Automatic Math Word Problem Solvers

MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers

MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning

MWPToolkit: an Open-Source Framework for Deep Learning-Based Math Word Problem Solvers.

RPN: A Word Vector Level Data Augmentation Algorithm in Deep Learning for Language Understanding

Augmenting Math Word Problems via Iterative Question Composing

Tree-structured Decoding for Solving MathWord Problems

DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving

MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms

MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning

DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning

Generating Math Word Problems from Equations with Topic Controlling and Commonsense Enforcement.

Techniques to Improve Neural Math Word Problem Solvers

MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

PersonaMath: Enhancing Math Reasoning through Persona-Driven Data Augmentation