Abstract:Current concerns about reproducibility in many research communities can be traced back to a high value placed on empirical reproducibility of the physical details of scientific experiments and observations. For example, the detailed descriptions by 17th century scientist Robert Boyle of his vacuum pump experiments are often held to be the ideal of reproducibility as a cornerstone of scientific practice. Victoria Stodden has claimed that the computer is an analog for Boyle's pump -- another kind of scientific instrument that needs detailed descriptions of how it generates results. In the place of Boyle's hand-written notes, we now expect code in open source programming languages to be available to enable others to reproduce and extend computational experiments. In this paper we show that there is another genealogy for reproducibility, starting at least from Euclid, in the production of proofs in mathematics. Proofs have a distinctive quality of being necessarily reproducible, and are the cornerstone of mathematical science. However, the task of the modern mathematical scientist has drifted from that of blackboard rhetorician, where the craft of proof reigned, to a scientific workflow that now more closely resembles that of an experimental scientist. So, what is proof in modern mathematics? And, if proof is unattainable in other fields, what is due scientific diligence in a computational experimental environment? How do we measure truth in the context of uncertainty? Adopting a manner of Lakatosian conversant conjecture between two mathematicians, we examine how proof informs our practice of computational statistical inquiry. We propose that a reorientation of mathematical science is necessary so that its reproducibility can be readily assessed.

Strange new universes: Proof assistants and synthetic foundations

Anatomy of a Formal Proof

math-PVS: A Large Language Model Framework to Map Scientific Publications to PVS Theories

A Survey of the Proof-Theoretic Foundations of Logic Programming

Don't Call Us, We'll Call You: Towards Mixed-Initiative Interactive Proof Assistants for Programming Language Theory

Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning

DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

Mathematical Formalized Problem Solving and Theorem Proving in Different Fields in Lean 4

Automated Completion of Statements and Proofs in Synthetic Geometry: an Approach based on Constraint Solving

Perspectives for proof unwinding by programming languages techniques

Mathematics and the formal turn

How Are Programs Found? Speculating About Language Ergonomics With Curry-Howard

Towards a Mathematics Formalisation Assistant using Large Language Models

Natural Language Specifications in Proof Assistants

Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs

Teaching Simple Constructive Proofs with Haskell Programs

Introduction to Mathematical Language Processing: Informal Proofs, Word Problems, and Supporting Tasks

Truth, Proof, and Reproducibility: There's no counter-attack for the codeless

Defining Logical Systems via Algebraic Constraints on Proofs