AI cracks hard maths

Alex Wilkins

DOI: https://doi.org/10.1016/s0262-4079(24)00157-x

IF: 0.906

2024-01-28

The New Scientist

Abstract:An AI from Google DeepMind scores almost as well as the best students on geometry questions from the International Mathematical Olympiad, finds Alex Wilkins

multidisciplinary sciences

What problem does this paper attempt to address?

DeepMind AI solves geometry problems at star-student level

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-024-00141-5

IF: 64.8

2024-01-18

Nature

Abstract:Algorithms are now as good at geometry as some of the world's most mathematically talented school kids. Algorithms are now as good at geometry as some of the world's most mathematically talented school kids.

multidisciplinary sciences
DeepMind hits milestone in solving maths problems — AI's next grand challenge

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-024-02441-2

IF: 64.8

2024-07-26

Nature

Abstract:AlphaProof showed its prowess on questions from this year's Mathematical Olympiad — a step in the race to create substantial proofs with artificial intelligence. AlphaProof showed its prowess on questions from this year's Mathematical Olympiad — a step in the race to create substantial proofs with artificial intelligence.

multidisciplinary sciences
DeepMind AI outdoes human mathematicians on unsolved problem

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-023-04043-w

IF: 64.8

2023-12-15

Nature

Abstract:Large language model improves on efforts to solve combinatorics problems inspired by the card game Set. Large language model improves on efforts to solve combinatorics problems inspired by the card game Set.

multidisciplinary sciences
Google AI algorithm masters ancient game of Go

Elizabeth Gibney

DOI: https://doi.org/10.1038/529445a

IF: 64.8

2016-01-27

Nature

Abstract:Deep-learning software defeats human professional for first time.

multidisciplinary sciences
DeepMind AI is a games master

Matthew Sparkes

DOI: https://doi.org/10.1016/s0262-4079(23)02185-1

2023-11-01

Abstract:System that beats humans at chess and poker could be a step towards general intelligence

multidisciplinary sciences
Google reveals secret test of AI bot to beat top Go players

Elizabeth Gibney

DOI: https://doi.org/10.1038/nature.2017.21253

IF: 64.8

2017-01-01

Nature

Abstract:Updated version of DeepMind's AlphaGo program behind mystery online competitor.

multidisciplinary sciences
DeepMind AI creates algorithms that sort data faster than those built by people

Matthew Hutson

DOI: https://doi.org/10.1038/d41586-023-01883-4

IF: 64.8

2023-06-08

Nature

Abstract:The technology developed by DeepMind that plays Go and chess can also help to write code. The technology developed by DeepMind that plays Go and chess can also help to write code.

multidisciplinary sciences
Limits of an AI program for solving college math problems

Ernest Davis

DOI: https://doi.org/10.48550/arXiv.2208.06906

IF: 14.4

2022-08-14

Artificial Intelligence

Abstract:Drori et al. (2022) report that "A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level ... [It] automatically answers 81\% of university-level mathematics problems." The system they describe is indeed impressive; however, the above description is very much overstated. The work of solving the problems is done, not by a neural network, but by the symbolic algebra package Sympy. Problems of various formats are excluded from consideration. The so-called "explanations" are just rewordings of lines of code. Answers are marked as correct that are not in the form specified in the problem. Most seriously, it seems that in many cases the system uses the correct answer given in the test corpus to guide its path to solving the problem.
Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry

Shiven Sinha,Ameya Prabhu,Ponnurangam Kumaraguru,Siddharth Bhat,Matthias Bethge

2024-04-11

Abstract:Proving geometric theorems constitutes a hallmark of visual reasoning combining both intuitive and logical skills. Therefore, automated theorem proving of Olympiad-level geometry problems is considered a notable milestone in human-level automated reasoning. The introduction of AlphaGeometry, a neuro-symbolic model trained with 100 million synthetic samples, marked a major breakthrough. It solved 25 of 30 International Mathematical Olympiad (IMO) problems whereas the reported baseline based on Wu's method solved only ten. In this note, we revisit the IMO-AG-30 Challenge introduced with AlphaGeometry, and find that Wu's method is surprisingly strong. Wu's method alone can solve 15 problems, and some of them are not solved by any of the other methods. This leads to two key findings: (i) Combining Wu's method with the classic synthetic methods of deductive databases and angle, ratio, and distance chasing solves 21 out of 30 methods by just using a CPU-only laptop with a time limit of 5 minutes per problem. Essentially, this classic method solves just 4 problems less than AlphaGeometry and establishes the first fully symbolic baseline strong enough to rival the performance of an IMO silver medalist. (ii) Wu's method even solves 2 of the 5 problems that AlphaGeometry failed to solve. Thus, by combining AlphaGeometry with Wu's method we set a new state-of-the-art for automated theorem proving on IMO-AG-30, solving 27 out of 30 problems, the first AI method which outperforms an IMO gold medalist.

Artificial Intelligence,Computational Geometry,Computation and Language,Machine Learning
Why mathematics is set to be revolutionized by AI

Thomas Fink

DOI: https://doi.org/10.1038/d41586-024-01413-w

IF: 64.8

2024-05-15

Nature

Abstract:Cheap data and the absence of coincidences make maths an ideal testing ground for AI-assisted discovery — but only humans will be able to tell good conjectures from bad ones. Cheap data and the absence of coincidences make maths an ideal testing ground for AI-assisted discovery — but only humans will be able to tell good conjectures from bad ones.

multidisciplinary sciences
Deep Learning in Automatic Math Word Problem Solvers

Dongxiang Zhang

DOI: https://doi.org/10.1007/978-3-031-09687-7_14

2022-01-01

Abstract:The design of an automatic solver for mathematical word problems (MWPs) dates back to the early 1960s and regained booming attention in recent years, owing to revolutionary advances in deep learning. Its objective is to parse the human-readable word problems into machine-understandable logical expressions. The problem is challenging due to the existence of a substantial semantic gap. To a certain extent, MWPs have been recognized as good test beds to evaluate the intelligence level of agents in terms of natural language understanding and automatic reasoning. The successful solving of MWPs can benefit online tutoring and constitute a milestone toward general AI. In this chapter, we present a general introduction to the technical evolution trend for MWP solvers in recent decades and pay particular attention to recent advancement with deep learning models. We also report their performances on public benchmark datasets, which can update readers’ understandings of the latest status of automatic math problem solvers.
When Doctors Meet with AlphaGo: Potential Application of Machine Learning to Clinical Medicine.

Zhongheng Zhang

DOI: https://doi.org/10.21037/atm.2016.03.25

IF: 3.616

2016-01-01

Annals of Translational Medicine

Abstract:March is a reluctant beginning of spring. After suddenly getting warmer, the weather has turned cold again. Yesterday, the friend circle of Wechat was full of a breaking news that the Google’s artificial intelligence AlphaGo beat human Go champion Lee Sedol. Or at least it was a temporary lead because there will be several rounds in following days. The news was a headline because it was related to the debate on whether artificial intelligence could defeat human brain. Many cultural celebrities posted their comments on the news. Shen Lei, a writer who is famous for his interpretation on Jin Yong’s Kung Fu novels, stated that: “ The last warrior falls. ” Tang Fenng also posted on his Wechat that: “ All calculations and computations can be left for machines from now on. What we humans can do are: burning incense, sipping tea, Washing inkstone, playing the Chinese zither…. ” In other words, all works with rules can be completed by machines, and humans have to retreat to their emotional domain. Why is it the Go, instead of other chesses such as Modern Ludo and animal checker, or other intellectual activities? That is because the Go represent the most complicated intellectual activity. The chessboard of Go is made up of 361 cross points, which in turn can generate numerous chess compositions. There are around 10 170 possible board configurations in the average 150-move game (1)! After all, this is much challenging than medical decision making. Two decades ago, the IBM supercomputer Deep Blue defeated the world chess champion Garry Kasparov (2). However, the chess is slightly inferior than Go in its complexity. Thus the AlphaGo’s victory has more far-reaching significance.
Advancing mathematics by guiding human intuition with AI

Alex Davies,Petar Veličković,Lars Buesing,Sam Blackwell,Daniel Zheng,Nenad Tomašev,Richard Tanburn,Peter Battaglia,Charles Blundell,András Juhász,Marc Lackenby,Geordie Williamson,Demis Hassabis,Pushmeet Kohli

DOI: https://doi.org/10.1038/s41586-021-04086-x

IF: 64.8

2021-12-01

Nature

Abstract:Abstract The practice of mathematics involves discovering patterns and using these to formulate and prove conjectures, resulting in theorems. Since the 1960s, mathematicians have used computers to assist in the discovery of patterns and formulation of conjectures 1 , most famously in the Birch and Swinnerton-Dyer conjecture 2 , a Millennium Prize Problem 3 . Here we provide examples of new fundamental results in pure mathematics that have been discovered with the assistance of machine learning—demonstrating a method by which machine learning can aid mathematicians in discovering new conjectures and theorems. We propose a process of using machine learning to discover potential patterns and relations between mathematical objects, understanding them with attribution techniques and using these observations to guide intuition and propose conjectures. We outline this machine-learning-guided framework and demonstrate its successful application to current research questions in distinct areas of pure mathematics, in each case showing how it led to meaningful mathematical contributions on important open problems: a new connection between the algebraic and geometric structure of knots, and a candidate algorithm predicted by the combinatorial invariance conjecture for symmetric groups 4 . Our work may serve as a model for collaboration between the fields of mathematics and artificial intelligence (AI) that can achieve surprising results by leveraging the respective strengths of mathematicians and machine learning.

multidisciplinary sciences
Solving olympiad geometry without human demonstrations

Trieu H. Trinh,Yuhuai Wu,Quoc V. Le,He He,Thang Luong

DOI: https://doi.org/10.1038/s41586-023-06747-5

IF: 64.8

2024-01-17

Nature

Abstract:Abstract Proving mathematical theorems at the olympiad level represents a notable milestone in human-level automated reasoning 1–4 , owing to their reputed difficulty among the world’s best talents in pre-university mathematics. Current machine-learning approaches, however, are not applicable to most mathematical domains owing to the high cost of translating human proofs into machine-verifiable format. The problem is even worse for geometry because of its unique translation challenges 1,5 , resulting in severe scarcity of training data. We propose AlphaGeometry, a theorem prover for Euclidean plane geometry that sidesteps the need for human demonstrations by synthesizing millions of theorems and proofs across different levels of complexity. AlphaGeometry is a neuro-symbolic system that uses a neural language model, trained from scratch on our large-scale synthetic data, to guide a symbolic deduction engine through infinite branching points in challenging problems. On a test set of 30 latest olympiad-level problems, AlphaGeometry solves 25, outperforming the previous best method that only solves ten problems and approaching the performance of an average International Mathematical Olympiad (IMO) gold medallist. Notably, AlphaGeometry produces human-readable proofs, solves all geometry problems in the IMO 2000 and 2015 under human expert evaluation and discovers a generalized version of a translated IMO theorem in 2004.

multidisciplinary sciences
A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level

Iddo Drori,Sarah Zhang,Reece Shuttleworth,Leonard Tang,Albert Lu,Elizabeth Ke,Kevin Liu,Linda Chen,Sunny Tran,Newman Cheng,Roman Wang,Nikhil Singh,Taylor L. Patti,Jayson Lynch,Avi Shporer,Nakul Verma,Eugene Wu,Gilbert Strang

DOI: https://doi.org/10.1073/pnas.2123433119

2022-05-31

Abstract:We demonstrate that a neural network pre-trained on text and fine-tuned on code solves mathematics course problems, explains solutions, and generates new questions at a human level. We automatically synthesize programs using few-shot learning and OpenAI's Codex transformer and execute them to solve course problems at 81% automatic accuracy. We curate a new dataset of questions from MIT's largest mathematics courses (Single Variable and Multivariable Calculus, Differential Equations, Introduction to Probability and Statistics, Linear Algebra, and Mathematics for Computer Science) and Columbia University's Computational Linear Algebra. We solve questions from a MATH dataset (on Prealgebra, Algebra, Counting and Probability, Intermediate Algebra, Number Theory, and Precalculus), the latest benchmark of advanced mathematics problems designed to assess mathematical reasoning. We randomly sample questions and generate solutions with multiple modalities, including numbers, equations, and plots. The latest GPT-3 language model pre-trained on text automatically solves only 18.8% of these university questions using zero-shot learning and 30.8% using few-shot learning and the most recent chain of thought prompting. In contrast, program synthesis with few-shot learning using Codex fine-tuned on code generates programs that automatically solve 81% of these questions. Our approach improves the previous state-of-the-art automatic solution accuracy on the benchmark topics from 8.8% to 81.1%. We perform a survey to evaluate the quality and difficulty of generated questions. This work is the first to automatically solve university-level mathematics course questions at a human level and the first work to explain and generate university-level mathematics course questions at scale, a milestone for higher education.

Machine Learning,Artificial Intelligence
‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures

Ewen Callaway

DOI: https://doi.org/10.1038/d41586-020-03348-4

IF: 64.8

2020-11-30

Nature

Abstract:An artificial intelligence (AI) network developed by Google AI offshoot DeepMind has made a gargantuan leap in solving one of biology's grandest challenges — determining a protein's 3D shape from its amino-acid sequence.

multidisciplinary sciences
MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

Lei Wang,Dongxiang Zhang,Lianli Gao,Jingkuan Song,Long Guo,Heng Tao Shen

DOI: https://doi.org/10.1609/aaai.v32i1.11981

2018-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Designing an automatic solver for math word problems has been considered as a crucial step towards general AI, with the ability of natural language understanding and logical inference. The state-of-the-art performance was achieved by enumerating all the possible expressions from the quantities in the text and customizing a scoring function to identify the one with the maximum probability. However, it incurs exponential search space with the number of quantities and beam search has to be applied to trade accuracy for efficiency. In this paper, we make the first attempt of applying deep reinforcement learning to solve arithmetic word problems. The motivation is that deep Q-network has witnessed success in solving various problems with big search space and achieves promising performance in terms of both accuracy and running time. To fit the math problem scenario, we propose our MathDQN that is customized from the general deep reinforcement learning framework. Technically, we design the states, actions, reward function, together with a feed-forward neural network as the deep Q-network. Extensive experimental results validate our superiority over state-of-the-art methods. Our MathDQN yields remarkable improvement on most of datasets and boosts the average precision among all the benchmark datasets by 15\%.
Human vs. Computer Go: Review and Prospect

Chang-Shing Lee,Mei-Hui Wang,Shi-Jim Yen,Ting-Han Wei,I-Chen Wu,Ping-Chiang Chou,Chun-Hsun Chou,Ming-Wan Wang,Tai-Hsiung Yang

DOI: https://doi.org/10.1109/MCI.2016.2572559

2016-06-07

Abstract:The Google DeepMind challenge match in March 2016 was a historic achievement for computer Go development. This article discusses the development of computational intelligence (CI) and its relative strength in comparison with human intelligence for the game of Go. We first summarize the milestones achieved for computer Go from 1998 to 2016. Then, the computer Go programs that have participated in previous IEEE CIS competitions as well as methods and techniques used in AlphaGo are briefly introduced. Commentaries from three high-level professional Go players on the five AlphaGo versus Lee Sedol games are also included. We conclude that AlphaGo beating Lee Sedol is a huge achievement in artificial intelligence (AI) based largely on CI methods. In the future, powerful computer Go programs such as AlphaGo are expected to be instrumental in promoting Go education and AI real-world applications.

Artificial Intelligence
Chess AI: Competing Paradigms for Machine Intelligence

Shiva Maharaj,Nick Polson,Alex Turk

DOI: https://doi.org/10.3390/e24040550

IF: 2.738

2022-04-14

Entropy

Abstract:Endgame studies have long served as a tool for testing human creativity and intelligence. We find that they can serve as a tool for testing machine ability as well. Two of the leading chess engines, Stockfish and Leela Chess Zero (LCZero), employ significantly different methods during play. We use Plaskett’s Puzzle, a famous endgame study from the late 1970s, to compare the two engines. Our experiments show that Stockfish outperforms LCZero on the puzzle. We examine the algorithmic differences between the engines and use our observations as a basis for carefully interpreting the test results. Drawing inspiration from how humans solve chess problems, we ask whether machines can possess a form of imagination. On the theoretical side, we describe how Bellman’s equation may be applied to optimize the probability of winning. To conclude, we discuss the implications of our work on artificial intelligence (AI) and artificial general intelligence (AGI), suggesting possible avenues for future research.

physics, multidisciplinary
FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI

Elliot Glazer,Ege Erdil,Tamay Besiroglu,Diego Chicharro,Evan Chen,Alex Gunning,Caroline Falkman Olsson,Jean-Stanislas Denain,Anson Ho,Emily de Oliveira Santos,Olli Järviniemi,Matthew Barnett,Robert Sandler,Jaime Sevilla,Qiuyu Ren,Elizabeth Pratt,Lionel Levine,Grant Barkley,Natalie Stewart,Bogdan Grechuk,Tetiana Grechuk,Shreepranav Varma Enugandla

2024-11-08

Abstract:We introduce FrontierMath, a benchmark of hundreds of original, exceptionally challenging mathematics problems crafted and vetted by expert mathematicians. The questions cover most major branches of modern mathematics -- from computationally intensive problems in number theory and real analysis to abstract questions in algebraic geometry and category theory. Solving a typical problem requires multiple hours of effort from a researcher in the relevant branch of mathematics, and for the upper end questions, multiple days. FrontierMath uses new, unpublished problems and automated verification to reliably evaluate models while minimizing risk of data contamination. Current state-of-the-art AI models solve under 2% of problems, revealing a vast gap between AI capabilities and the prowess of the mathematical community. As AI systems advance toward expert-level mathematical abilities, FrontierMath offers a rigorous testbed that quantifies their progress.

Artificial Intelligence

AI cracks hard maths

DeepMind AI solves geometry problems at star-student level

DeepMind hits milestone in solving maths problems — AI's next grand challenge

DeepMind AI outdoes human mathematicians on unsolved problem

Google AI algorithm masters ancient game of Go

DeepMind AI is a games master

Google reveals secret test of AI bot to beat top Go players

DeepMind AI creates algorithms that sort data faster than those built by people

Limits of an AI program for solving college math problems

Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry

Why mathematics is set to be revolutionized by AI

Deep Learning in Automatic Math Word Problem Solvers

When Doctors Meet with AlphaGo: Potential Application of Machine Learning to Clinical Medicine.

Advancing mathematics by guiding human intuition with AI

Solving olympiad geometry without human demonstrations

A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level

‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures

MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

Human vs. Computer Go: Review and Prospect

Chess AI: Competing Paradigms for Machine Intelligence

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI