Abstract:Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a specific dataset to perform well on particular domains, such as undergraduate-level mathematics. These methods struggle with generalizability to advanced mathematics. A fundamental limitation is that these approaches operate on static domains, failing to capture how mathematicians often work across multiple domains and projects simultaneously or cyclically. We present LeanAgent, a novel lifelong learning framework for theorem proving that continuously generalizes to and improves on ever-expanding mathematical knowledge without forgetting previously learned knowledge. LeanAgent introduces several key innovations, including a curriculum learning strategy that optimizes the learning trajectory in terms of mathematical difficulty, a dynamic database for efficient management of evolving mathematical knowledge, and progressive training to balance stability and plasticity. LeanAgent successfully proves 162 theorems previously unproved by humans across 23 diverse Lean repositories, many from advanced mathematics. It performs significantly better than the static LLM baseline, proving challenging theorems in domains like abstract algebra and algebraic topology while showcasing a clear progression of learning from basic concepts to advanced topics. In addition, we analyze LeanAgent's superior performance on key lifelong learning metrics. LeanAgent achieves exceptional scores in stability and backward transfer, where learning new tasks improves performance on previously learned tasks. This emphasizes LeanAgent's continuous generalizability and improvement, explaining its superior theorem-proving performance.

HOList: An Environment for Machine Learning of Higher-Order Theorem Proving

Holophrasm: a neural Automated Theorem Prover for higher-order logic

Tableaux for Automated Reasoning in Dependently-Typed Higher-Order Logic (Extended Version)

A Survey on Deep Learning for Theorem Proving

A Formal Proof of the Expressiveness of Deep Learning

DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

LeanDojo: Theorem Proving with Retrieval-Augmented Language Models

Automated Theorem Proving in Intuitionistic Propositional Logic by Deep Reinforcement Learning

The Higher-Order Prover Leo-III (Extended Version)

Proof searching and prediction in HOL4 with evolutionary/heuristic and deep learning techniques

Automating Free Logic in HOL, with an Experimental Application in Category Theory

Proving Theorems using Incremental Learning and Hindsight Experience Replay

LeanAgent: Lifelong Learning for Formal Theorem Proving

Graph Representations for Higher-Order Logic and Theorem Proving

Theorem Proving in Dependently-Typed Higher-Order Logic -- Extended Preprint

Learning to Reason with HOL4 tactics

Towards Large Language Models as Copilots for Theorem Proving in Lean

A Theorem Prover for Quantum Hoare Logic and Its Applications

Language and Proofs for Higher-Order SMT (Work in Progress)

Mechanized HOL Reasoning in Set Theory

HOL(y)Hammer: Online ATP Service for HOL Light