Abstract:The rapid advancement of large language models (LLMs) such as GPT-3, PaLM, and Llama has significantly transformed natural language processing, showcasing remarkable capabilities in understanding and generating language. However, these models often struggle with tasks requiring complex reasoning, particularly in mathematical problem-solving, due in part to the scarcity of large-scale, high-quality, domain-specific datasets necessary for training sophisticated reasoning abilities. To address this limitation, we introduce Template-based Data Generation (TDG), a novel approach that leverages LLMs (GPT-4) to automatically generate parameterized meta-templates, which are then used to synthesize a vast array of high-quality problems and solutions. Leveraging TDG, we create TemplateMath Part I: TemplateGSM, a dataset comprising over 7 million synthetically generated grade school math problems--each accompanied by code-based and natural language solutions--with the potential to generate an effectively unlimited number more. This dataset alleviates the scarcity of large-scale mathematical datasets and serves as a valuable resource for pre-training, fine-tuning, and evaluating LLMs in mathematical reasoning. Our method not only enables the generation of virtually infinite data but also elevates data augmentation to a new level by using GPT-4 for meta-template generation, ensuring diverse and high-quality problem structures. The TemplateMath Part I: TemplateGSM dataset is publicly available at <a class="link-external link-https" href="https://huggingface.co/datasets/math-ai/TemplateGSM" rel="external noopener nofollow">this https URL</a>. The code is available at <a class="link-external link-https" href="https://github.com/iiis-ai/TemplateMath" rel="external noopener nofollow">this https URL</a>.

Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation

Contextualizing Problems to Student Interests at Scale in Intelligent Tutoring System Using Large Language Models

Generative AI for Enhancing Active Learning in Education: A Comparative Study of GPT-3.5 and GPT-4 in Crafting Customized Test Questions

MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers

Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification

Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors

MWPToolkit: an Open-Source Framework for Deep Learning-Based Math Word Problem Solvers.

MATHWELL: Generating Educational Math Word Problems Using Teacher Annotations

Teaching Plan Generation and Evaluation With GPT-4: Unleashing the Potential of LLM in Instructional Design

MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning

Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models

Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Level

GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomes

Training and Evaluating Language Models with Template-based Data Generation

AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrails

BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search

MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

Evaluating and Optimizing Educational Content with Large Language Model Judgments