Some thoughts on automation and mathematical research

Akshay Venkatesh

DOI: https://doi.org/10.1090/bull/1834

2024-02-16

Bulletin of the American Mathematical Society

Abstract:I discuss how mathematicians come to a shared notion of what is important, and how automated reasoning might affect that process.

mathematics

What problem does this paper attempt to address?

Automation compels mathematicians to reflect on our values

Michael Harris

DOI: https://doi.org/10.1090/bull/1825

2024-02-15

Bulletin of the American Mathematical Society

Abstract:The author takes colleagues to task for failing to “live deliberately,” and specifically for failing to pay attention to debates over technology and artificial intelligence in the wider society, when contemplating a mechanical future for mathematics.

mathematics
Mathematical reasoning and the computer

Kevin Buzzard

DOI: https://doi.org/10.1090/bull/1833

2024-02-15

Bulletin of the American Mathematical Society

Abstract:Computers have already changed the way that humans do mathematics: they enable us to compute efficiently. But will they soon be helping us to reason ? And will they one day start reasoning themselves? We give an overview of recent developments in neural networks, computer theorem provers, and large language models.

mathematics
Notes on a Path to AI Assistance in Mathematical Reasoning

Alex Kontorovich

2023-10-04

Abstract:These informal notes are based on the author's lecture at the National Academies of Science, Engineering, and Mathematics workshop on "AI to Assist Mathematical Reasoning" in June 2023. The goal is to think through a path by which we might arrive at AI that is useful for the research mathematician.

History and Overview,Artificial Intelligence
AlephZero and Mathematical Experience

Simon DeDeo

DOI: https://doi.org/10.1090/bull/1824

2023-09-08

Abstract:This essay explores the impact of automated proof construction on three key areas of mathematical cognition: on how we judge the role one piece of mathematics plays in another, on how we make mistakes in reasoning about mathematical objects, and on how we understand what our theorems are truly about. It concludes by speculating on a new form of mathematical experience that these methods could make possible: ``glitching'', a game-like search for uncanny consequences of our definitions.

History and Overview
Apriori Knowledge in an Era of Computational Opacity: The Role of AI in Mathematical Discovery

Eamon Duede,Kevin Davey

2024-03-16

Abstract:Computation is central to contemporary mathematics. Many accept that we can acquire genuine mathematical knowledge of the Four Color Theorem from Appel and Haken's program insofar as it is simply a repetitive application of human forms of mathematical reasoning. Modern LLMs / DNNs are, by contrast, opaque to us in significant ways, and this creates obstacles in obtaining mathematical knowledge from them. We argue, however, that if a proof-checker automating human forms of proof-checking is attached to such machines, then we can obtain apriori mathematical knowledge from them, even though the original machines are entirely opaque to us and the proofs they output are not human-surveyable.

Artificial Intelligence,Human-Computer Interaction,History and Overview
Automated mathematics and the reconfiguration of proof and labor

Rodrigo Ochigame

DOI: https://doi.org/10.1090/bull/1821

2024-05-25

Bulletin of the American Mathematical Society

Abstract:Rodrigo Ochigame Bull. Amer. Math. Soc. 61 (), 423-437. , references and article information

mathematics
Why mathematics is set to be revolutionized by AI

Thomas Fink

DOI: https://doi.org/10.1038/d41586-024-01413-w

IF: 64.8

2024-05-15

Nature

Abstract:Cheap data and the absence of coincidences make maths an ideal testing ground for AI-assisted discovery — but only humans will be able to tell good conjectures from bad ones. Cheap data and the absence of coincidences make maths an ideal testing ground for AI-assisted discovery — but only humans will be able to tell good conjectures from bad ones.

multidisciplinary sciences
On mathematics and knowledge

Daniel Canarutto

2023-10-20

Abstract:A sketch of some of the fundamental notions related to the nature of knowledge is offered, with special focus on the role of mathematics and my own opinions. No single idea exposed here is entirely original; indeed, this topic has been explored by legions of philosophers, mathematicians, and scientists throughout history -- I listed a few related books among the references. I look forward to observations and criticisms that may serve to improve this exposition.

History and Overview,Mathematical Physics,History and Philosophy of Physics
Introduction to Mathematical Language Processing: Informal Proofs, Word Problems, and Supporting Tasks

Jordan Meadows,André Freitas

DOI: https://doi.org/10.1162/tacl_a_00594

IF: 10.9

2023-01-01

Transactions of the Association for Computational Linguistics

Abstract:Abstract Automating discovery in mathematics and science will require sophisticated methods of information extraction and abstract reasoning, including models that can convincingly process relationships between mathematical elements and natural language, to produce problem solutions of real-world value. We analyze mathematical language processing methods across five strategic sub-areas (identifier-definition extraction, formula retrieval, natural language premise selection, math word problem solving, and informal theorem proving) from recent years, highlighting prevailing methodologies, existing limitations, overarching trends, and promising avenues for future research.

English Else
A Triumvirate of AI Driven Theoretical Discovery

Yang-Hui He

2024-05-30

Abstract:Recent years have seen the dramatic rise of the usage of AI algorithms in pure mathematics and fundamental sciences such as theoretical physics. This is perhaps counter-intuitive since mathematical sciences require the rigorous definitions, derivations, and proofs, in contrast to the experimental sciences which rely on the modelling of data with error-bars. In this Perspective, we categorize the approaches to mathematical discovery as "top-down", "bottom-up" and "meta-mathematics", as inspired by historical examples. We review some of the progress over the last few years, comparing and contrasting both the advances and the short-comings in each approach. We argue that while the theorist is in no way in danger of being replaced by AI in the near future, the hybrid of human expertise and AI algorithms will become an integral part of theoretical discovery.

History and Overview,High Energy Physics - Theory,History and Philosophy of Physics
Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems

Keyur Faldu,Amit Sheth,Prashant Kikani,Manas Gaur,Aditi Avasthi

DOI: https://doi.org/10.48550/arXiv.2111.05364

2021-10-29

Abstract:Mathematical reasoning would be one of the next frontiers for artificial intelligence to make significant progress. The ongoing surge to solve math word problems (MWPs) and hence achieve better mathematical reasoning ability would continue to be a key line of research in the coming time. We inspect non-neural and neural methods to solve math word problems narrated in a natural language. We also highlight the ability of these methods to be generalizable, mathematically reasonable, interpretable, and explainable. Neural approaches dominate the current state of the art, and we survey them highlighting three strategies to MWP solving: (1) direct answer generation, (2) expression tree generation for inferring answers, and (3) template retrieval for answer computation. Moreover, we discuss technological approaches, review the evolution of intuitive design choices to solve MWPs, and examine them for mathematical reasoning ability. We finally identify several gaps that warrant the need for external knowledge and knowledge-infused learning, among several other opportunities in solving MWPs.

Computation and Language,Artificial Intelligence
Establishing trust in automated reasoning

Konrad Hinsen

2023-08-31

Abstract:Since its beginnings in the 1940s, automated reasoning by computers has become a tool of ever growing importance in scientific research. So far, the rules underlying automated reasoning have mainly been formulated by humans, in the form of program source code. Rules derived from large amounts of data, via machine learning techniques, are a complementary approach currently under intense development. The question of why we should trust these systems, and the results obtained with their help, has been discussed by philosophers of science but has so far received little attention by practitioners. The present work focuses on independent reviewing, an important source of trust in science, and identifies the characteristics of automated reasoning systems that affect their reviewability. It also discusses possible steps towards increasing reviewability and trustworthiness via a combination of technical and social measures.

Computers and Society,Artificial Intelligence
AI for Mathematics: A Cognitive Science Perspective

Cedegao E. Zhang,Katherine M. Collins,Adrian Weller,Joshua B. Tenenbaum

2023-10-19

Abstract:Mathematics is one of the most powerful conceptual systems developed and used by the human species. Dreams of automated mathematicians have a storied history in artificial intelligence (AI). Rapid progress in AI, particularly propelled by advances in large language models (LLMs), has sparked renewed, widespread interest in building such systems. In this work, we reflect on these goals from a \textit{cognitive science} perspective. We call attention to several classical and ongoing research directions from cognitive science, which we believe are valuable for AI practitioners to consider when seeking to build truly human (or superhuman)-level mathematical systems. We close with open discussions and questions that we believe necessitate a multi-disciplinary perspective -- cognitive scientists working in tandem with AI researchers and mathematicians -- as we move toward better mathematical AI systems which not only help us push the frontier of the mathematics, but also offer glimpses into how we as humans are even capable of such great cognitive feats.

Neurons and Cognition,Artificial Intelligence
The roots of mathematical thought

Harry Tamvakis

DOI: https://doi.org/10.48550/arXiv.2006.07247

2022-07-06

Abstract:In this paper, I explore what mathematical research can tell us about ourselves, and our role in the world, using examples from my own experience. The paper is a sequel to my piece "Mathematics is a Quest for Truth", published in the Notices of the American Mathematical Society in 2014.

History and Overview
Mathematical practice, crowdsourcing, and social machines

Ursula Martin,Alison Pease

DOI: https://doi.org/10.48550/arXiv.1305.0900

2013-05-04

Abstract:The highest level of mathematics has traditionally been seen as a solitary endeavour, to produce a proof for review and acceptance by research peers. Mathematics is now at a remarkable inflexion point, with new technology radically extending the power and limits of individuals. Crowdsourcing pulls together diverse experts to solve problems; symbolic computation tackles huge routine calculations; and computers check proofs too long and complicated for humans to comprehend. Mathematical practice is an emerging interdisciplinary field which draws on philosophy and social science to understand how mathematics is produced. Online mathematical activity provides a novel and rich source of data for empirical investigation of mathematical practice - for example the community question answering system {\it mathoverflow} contains around 40,000 mathematical conversations, and {\it polymath} collaborations provide transcripts of the process of discovering proofs. Our preliminary investigations have demonstrated the importance of "soft" aspects such as analogy and creativity, alongside deduction and proof, in the production of mathematics, and have given us new ways to think about the roles of people and machines in creating new mathematical knowledge. We discuss further investigation of these resources and what it might reveal. Crowdsourced mathematical activity is an example of a "social machine", a new paradigm, identified by Berners-Lee, for viewing a combination of people and computers as a single problem-solving entity, and the subject of major international research endeavours. We outline a future research agenda for mathematics social machines, a combination of people, computers, and mathematical archives to create and apply mathematics, with the potential to change the way people do mathematics, and to transform the reach, pace, and impact of mathematics research.

Social and Information Networks,Digital Libraries,History and Overview,Physics and Society
Boldly Going Where No Prover Has Gone Before

Giles Reger

DOI: https://doi.org/10.4204/EPTCS.311.6

2019-12-30

Abstract:I argue that the most interesting goal facing researchers in automated reasoning is being able to solve problems that cannot currently be solved by existing tools and methods. This may appear obvious, and is clearly not an original thought, but focusing on this as a primary goal allows us to examine other goals in a new light. Many successful theorem provers employ a portfolio of different methods for solving problems. This changes the landscape on which we perform our research: solving problems that can already be solved may not improve the state of the art and a method that can solve a handful of problems unsolvable by current methods, but generally performs poorly on most problems, can be very useful. We acknowledge that forcing new methods to compete against portfolio solvers can stifle innovation. However, this is only the case when comparisons are made at the level of total problems solved. We propose a movement towards focussing on unique solutions in evaluation and competitions i.e. measuring the potential contribution to a portfolio solver. This state of affairs is particularly prominent in first-order logic, which is undecidable. When reasoning in a decidable logic there can be a focus on optimising a decision procedure and measuring average solving times. But in a setting where solutions are difficult to find, average solving times lose meaning, and whilst improving the efficiency of a technique can move potential solutions within acceptable time limits, in general, complementary strategies may be more successful.

Logic in Computer Science,Artificial Intelligence
Challenges to Some Philosophical Claims about Mathematics

Eliahu Levy

DOI: https://doi.org/10.48550/arXiv.1601.07125

2016-01-26

History and Overview

Abstract:In this note some philosophical thoughts and observations about mathematics are expressed, arranged as challenges to some common claims.
Database-Driven Mathematical Inquiry

Steven Clontz

2024-04-11

Abstract:Recent advances in computing have changed not only the nature of mathematical computation, but mathematical proof and inquiry itself. While artificial intelligence and formalized mathematics have been the major topics of this conversation, this paper explores another class of tools for advancing mathematics research: databases of mathematical objects that enable semantic search. In addition to defining and exploring examples of these tools, we illustrate a particular line of research that was inspired and enabled by one such database.

Databases,History and Overview
Varieties of mathematical understanding

Jeremy Avigad

DOI: https://doi.org/10.1090/bull/1726

2023-10-31

Abstract:This essay considers ways that recent uses of computers in mathematics challenge contemporary views on the nature of mathematical understanding. It also puts these challenges in a historical perspective and offers speculation as to a possible resolution.

History and Overview
Peano: Learning Formal Mathematical Reasoning

Gabriel Poesia,Noah D. Goodman

DOI: https://doi.org/10.1098/rsta.2022.0044

2022-11-29

Abstract:General mathematical reasoning is computationally undecidable, but humans routinely solve new problems. Moreover, discoveries developed over centuries are taught to subsequent generations quickly. What structure enables this, and how might that inform automated mathematical reasoning? We posit that central to both puzzles is the structure of procedural abstractions underlying mathematics. We explore this idea in a case study on 5 sections of beginning algebra on the Khan Academy platform. To define a computational foundation, we introduce Peano, a theorem-proving environment where the set of valid actions at any point is finite. We use Peano to formalize introductory algebra problems and axioms, obtaining well-defined search problems. We observe existing reinforcement learning methods for symbolic reasoning to be insufficient to solve harder problems. Adding the ability to induce reusable abstractions ("tactics") from its own solutions allows an agent to make steady progress, solving all problems. Furthermore, these abstractions induce an order to the problems, seen at random during training. The recovered order has significant agreement with the expert-designed Khan Academy curriculum, and second-generation agents trained on the recovered curriculum learn significantly faster. These results illustrate the synergistic role of abstractions and curricula in the cultural transmission of mathematics.

Artificial Intelligence

Some thoughts on automation and mathematical research

Automation compels mathematicians to reflect on our values

Mathematical reasoning and the computer

Notes on a Path to AI Assistance in Mathematical Reasoning

AlephZero and Mathematical Experience

Apriori Knowledge in an Era of Computational Opacity: The Role of AI in Mathematical Discovery

Automated mathematics and the reconfiguration of proof and labor

Why mathematics is set to be revolutionized by AI

On mathematics and knowledge

Introduction to Mathematical Language Processing: Informal Proofs, Word Problems, and Supporting Tasks

A Triumvirate of AI Driven Theoretical Discovery

Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems

Establishing trust in automated reasoning

AI for Mathematics: A Cognitive Science Perspective

The roots of mathematical thought

Mathematical practice, crowdsourcing, and social machines

Boldly Going Where No Prover Has Gone Before

Challenges to Some Philosophical Claims about Mathematics

Database-Driven Mathematical Inquiry

Varieties of mathematical understanding

Peano: Learning Formal Mathematical Reasoning