Abstract:It has been suggested that large language models such as GPT-4 have acquired some form of understanding beyond the correlations among the words in text including some understanding of mathematics as well. Here, we perform a critical inquiry into this claim by evaluating the mathematical understanding of the GPT-4 model. Considering that GPT-4's training set is a secret, it is not straightforward to evaluate whether the model's correct answers are based on a mathematical understanding or based on replication of proofs that the model has seen before. We specifically craft mathematical questions which their formal proofs are not readily available on the web, proofs that are more likely not seen by the GPT-4. We see that GPT-4 is unable to solve those problems despite their simplicity. It is hard to find scientific evidence suggesting that GPT-4 has acquired an understanding of even basic mathematical concepts. A straightforward way to find failure modes of GPT-4 in theorem proving is to craft questions where their formal proofs are not available on the web. Our finding suggests that GPT-4's ability is to reproduce, rephrase, and polish the mathematical proofs that it has seen before, and not in grasping mathematical concepts. We also see that GPT-4's ability to prove mathematical theorems is continuously expanding over time despite the claim that it is a fixed model. We suggest that the task of proving mathematical theorems in formal language is comparable to the methods used in search engines such as Google while predicting the next word in a sentence may be a misguided approach, a recipe that often leads to excessive extrapolation and eventual failures. Prompting the GPT-4 over and over may benefit the GPT-4 and the OpenAI, but we question whether it is valuable for machine learning or for theorem proving.

Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models

Performance of Large Language Models in a Computer Science Degree Program

Can LLMs Master Math? Investigating Large Language Models on Math Stack Exchange

Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understanding

How well do Large Language Models perform in Arithmetic tasks?

Mathify: Evaluating Large Language Models on Mathematical Problem Solving Tasks

Evaluating Language Models for Mathematics through Interactions

MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models

Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models

Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course

Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation

Towards Scalable Automated Grading: Leveraging Large Language Models for Conceptual Question Evaluation in Engineering

Training and Evaluating Language Models with Template-based Data Generation

A Large Language Model Approach to Educational Survey Feedback Analysis

Large Language Models' Understanding of Math: Source Criticism and Extrapolation

MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning

Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Level

Large Language Models for Mathematicians