Abstract:It has been suggested that large language models such as GPT-4 have acquired some form of understanding beyond the correlations among the words in text including some understanding of mathematics as well. Here, we perform a critical inquiry into this claim by evaluating the mathematical understanding of the GPT-4 model. Considering that GPT-4's training set is a secret, it is not straightforward to evaluate whether the model's correct answers are based on a mathematical understanding or based on replication of proofs that the model has seen before. We specifically craft mathematical questions which their formal proofs are not readily available on the web, proofs that are more likely not seen by the GPT-4. We see that GPT-4 is unable to solve those problems despite their simplicity. It is hard to find scientific evidence suggesting that GPT-4 has acquired an understanding of even basic mathematical concepts. A straightforward way to find failure modes of GPT-4 in theorem proving is to craft questions where their formal proofs are not available on the web. Our finding suggests that GPT-4's ability is to reproduce, rephrase, and polish the mathematical proofs that it has seen before, and not in grasping mathematical concepts. We also see that GPT-4's ability to prove mathematical theorems is continuously expanding over time despite the claim that it is a fixed model. We suggest that the task of proving mathematical theorems in formal language is comparable to the methods used in search engines such as Google while predicting the next word in a sentence may be a misguided approach, a recipe that often leads to excessive extrapolation and eventual failures. Prompting the GPT-4 over and over may benefit the GPT-4 and the OpenAI, but we question whether it is valuable for machine learning or for theorem proving.

Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology

Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From A Psychological Perspective

Large Language Models Are Unconscious of Unreasonability in Math Problems

Large Language Models for Mathematical Reasoning: Progresses and Challenges

Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments

Interpreting and Improving Large Language Models in Arithmetic Calculation

Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning

Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?

Can LLMs Master Math? Investigating Large Language Models on Math Stack Exchange

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

How well do Large Language Models perform in Arithmetic tasks?

Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions

Large Language Models' Understanding of Math: Source Criticism and Extrapolation

Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems

A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges

Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process

INC-Math: Integrating Natural Language and Code for Enhanced Mathematical Reasoning in Large Language Models