Abstract:Current concerns about reproducibility in many research communities can be traced back to a high value placed on empirical reproducibility of the physical details of scientific experiments and observations. For example, the detailed descriptions by 17th century scientist Robert Boyle of his vacuum pump experiments are often held to be the ideal of reproducibility as a cornerstone of scientific practice. Victoria Stodden has claimed that the computer is an analog for Boyle's pump -- another kind of scientific instrument that needs detailed descriptions of how it generates results. In the place of Boyle's hand-written notes, we now expect code in open source programming languages to be available to enable others to reproduce and extend computational experiments. In this paper we show that there is another genealogy for reproducibility, starting at least from Euclid, in the production of proofs in mathematics. Proofs have a distinctive quality of being necessarily reproducible, and are the cornerstone of mathematical science. However, the task of the modern mathematical scientist has drifted from that of blackboard rhetorician, where the craft of proof reigned, to a scientific workflow that now more closely resembles that of an experimental scientist. So, what is proof in modern mathematics? And, if proof is unattainable in other fields, what is due scientific diligence in a computational experimental environment? How do we measure truth in the context of uncertainty? Adopting a manner of Lakatosian conversant conjecture between two mathematicians, we examine how proof informs our practice of computational statistical inquiry. We propose that a reorientation of mathematical science is necessary so that its reproducibility can be readily assessed.

Mathematical Proof and Genre Theory

Mathematical Character Between the Instrument and Culture: the Exploration of Mathematical Significance from the Concept of Patterned Mathematical Ontology

Mathematics and the formal turn

Proof mining and probability theory

Hard Proofs and Good Reasons

Mathematical Proofs 101: How Proofs Should Be Read, Written, and Taught

Bridging knowing and proving in mathematics An essay from a didactical perspective

What is Mathematics? Perspectives Inspired by Anthropology

Constructive Mathematics

Student Sense-Making in Post-Secondary Introductory Proof Courses: An Argument for and Outline of a Methodological Approach

Argumentation theory for mathematical argument

Interatomic potentials for atomistic simulations of the Ti-Al system

On Wittgenstein's philosophy of mathematics

Proofs, proofs, proofs, and proofs

NaturalProver: Grounded Mathematical Proof Generation with Language Models

Perspectives for proof unwinding by programming languages techniques

Proof phenomenon as a function of the phenomenology of proving

Mathematics: abstraction and reality. A sketch toward deeper analysis

Truth, Proof, and Reproducibility: There's no counter-attack for the codeless

Transitioning to proof via writing scripts on the rules of a new discourse