Abstract:Despite the success of large language models (LLMs), the task of theorem proving still remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods using language models have demonstrated promising results, but they still struggle to prove even middle school level theorems. One common limitation of these methods is that they assume a fixed theorem library during the whole theorem proving process. However, as we all know, creating new useful theorems or even new theories is not only helpful but crucial and necessary for advancing mathematics and proving harder and deeper results. In this work, we present LEGO-Prover, which employs a growing skill library containing verified lemmas as skills to augment the capability of LLMs used in theorem proving. By constructing the proof modularly, LEGO-Prover enables LLMs to utilize existing skills retrieved from the library and to create new skills during the proving process. These skills are further evolved (by prompting an LLM) to enrich the library on another scale. Modular and reusable skills are constantly added to the library to enable tackling increasingly intricate mathematical problems. Moreover, the learned library further bridges the gap between human proofs and formal proofs by making it easier to impute missing steps. LEGO-Prover advances the state-of-the-art pass rate on miniF2F-valid (48.0% to 57.0%) and miniF2F-test (45.5% to 47.1%). During the proving process, LEGO-Prover also manages to generate over 20,000 skills (theorems/lemmas) and adds them to the growing library. Our ablation study indicates that these newly added skills are indeed helpful for proving theorems, resulting in an improvement from a success rate of 47.1% to 50.4%. We also release our code and all the generated skills.

Multimedia Lego Learning Structured Model By Probabilistic Logic Ontology Tree

LEGO-MM: LEarning Structured Model by Probabilistic loGic Ontology Tree for MultiMedia.

Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling

Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks

LEGO: Language Model Building Blocks

Learning concepts by modeling relationships

Break and Make: Interactive Structural Understanding Using LEGO Bricks

Learning to Build by Building Your Own Instructions

LEGO-Prover: Neural Theorem Proving with Growing Libraries

OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding

LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning

RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation

Image2Lego: Customized LEGO Set Generation from Images

Language-Image Models with 3D Understanding

Object-Centric Instruction Augmentation for Robotic Manipulation

Multimedia ontology modeling: An approach based on MPEG-7

ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation

CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models

LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

LEGO: A Hybrid Toolkit for Efficient 2Pc-Based Privacy-Preserving Machine Learning

MM-Lego: Modular Biomedical Multimodal Models with Minimal Fine-Tuning