Abstract:Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a specific dataset to perform well on particular domains, such as undergraduate-level mathematics. These methods struggle with generalizability to advanced mathematics. A fundamental limitation is that these approaches operate on static domains, failing to capture how mathematicians often work across multiple domains and projects simultaneously or cyclically. We present LeanAgent, a novel lifelong learning framework for theorem proving that continuously generalizes to and improves on ever-expanding mathematical knowledge without forgetting previously learned knowledge. LeanAgent introduces several key innovations, including a curriculum learning strategy that optimizes the learning trajectory in terms of mathematical difficulty, a dynamic database for efficient management of evolving mathematical knowledge, and progressive training to balance stability and plasticity. LeanAgent successfully proves 162 theorems previously unproved by humans across 23 diverse Lean repositories, many from advanced mathematics. It performs significantly better than the static LLM baseline, proving challenging theorems in domains like abstract algebra and algebraic topology while showcasing a clear progression of learning from basic concepts to advanced topics. In addition, we analyze LeanAgent's superior performance on key lifelong learning metrics. LeanAgent achieves exceptional scores in stability and backward transfer, where learning new tasks improves performance on previously learned tasks. This emphasizes LeanAgent's continuous generalizability and improvement, explaining its superior theorem-proving performance.

LEMMA: Bootstrapping High-Level Mathematical Reasoning with Learned Symbolic Abstractions

Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning

LeanAgent: Lifelong Learning for Formal Theorem Proving

Assessing the Emergent Symbolic Reasoning Abilities of Llama Large Language Models

Peano: Learning Formal Mathematical Reasoning

Learning From Mistakes Makes LLM Better Reasoner

Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent

Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions

Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library

Meaningful Learning: Advancing Abstract Reasoning in Large Language Models Via Generic Fact Guidance.

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

Llemma: An Open Language Model For Mathematics

InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning

Meaningful Learning: Enhancing Abstract Reasoning in Large Language Models via Generic Fact Guidance

Evaluating Mathematical Reasoning Beyond Accuracy

MALT: Improving Reasoning with Multi-Agent LLM Training

Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models

Solving Math Word Problems by Combining Language Models With Symbolic Solvers

Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models

Democratizing Reasoning Ability: Tailored Learning from Large Language Model