DeepMind AI outdoes human mathematicians on unsolved problem

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-023-04043-w

IF: 64.8

2023-12-15

Nature

Abstract:Large language model improves on efforts to solve combinatorics problems inspired by the card game Set. Large language model improves on efforts to solve combinatorics problems inspired by the card game Set.

multidisciplinary sciences

What problem does this paper attempt to address?

DeepMind hits milestone in solving maths problems — AI's next grand challenge

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-024-02441-2

IF: 64.8

2024-07-26

Nature

Abstract:AlphaProof showed its prowess on questions from this year's Mathematical Olympiad — a step in the race to create substantial proofs with artificial intelligence. AlphaProof showed its prowess on questions from this year's Mathematical Olympiad — a step in the race to create substantial proofs with artificial intelligence.

multidisciplinary sciences
DeepMind AI solves geometry problems at star-student level

Davide Castelvecchi

DOI: https://doi.org/10.1038/d41586-024-00141-5

IF: 64.8

2024-01-18

Nature

Abstract:Algorithms are now as good at geometry as some of the world's most mathematically talented school kids. Algorithms are now as good at geometry as some of the world's most mathematically talented school kids.

multidisciplinary sciences
AI cracks hard maths

Alex Wilkins

DOI: https://doi.org/10.1016/s0262-4079(24)00157-x

IF: 0.906

2024-01-28

The New Scientist

Abstract:An AI from Google DeepMind scores almost as well as the best students on geometry questions from the International Mathematical Olympiad, finds Alex Wilkins

multidisciplinary sciences
DeepMind AI is a games master

Matthew Sparkes

DOI: https://doi.org/10.1016/s0262-4079(23)02185-1

2023-11-01

Abstract:System that beats humans at chess and poker could be a step towards general intelligence

multidisciplinary sciences
DeepMind AI creates algorithms that sort data faster than those built by people

Matthew Hutson

DOI: https://doi.org/10.1038/d41586-023-01883-4

IF: 64.8

2023-06-08

Nature

Abstract:The technology developed by DeepMind that plays Go and chess can also help to write code. The technology developed by DeepMind that plays Go and chess can also help to write code.

multidisciplinary sciences
Deep Learning in Automatic Math Word Problem Solvers

Dongxiang Zhang

DOI: https://doi.org/10.1007/978-3-031-09687-7_14

2022-01-01

Abstract:The design of an automatic solver for mathematical word problems (MWPs) dates back to the early 1960s and regained booming attention in recent years, owing to revolutionary advances in deep learning. Its objective is to parse the human-readable word problems into machine-understandable logical expressions. The problem is challenging due to the existence of a substantial semantic gap. To a certain extent, MWPs have been recognized as good test beds to evaluate the intelligence level of agents in terms of natural language understanding and automatic reasoning. The successful solving of MWPs can benefit online tutoring and constitute a milestone toward general AI. In this chapter, we present a general introduction to the technical evolution trend for MWP solvers in recent decades and pay particular attention to recent advancement with deep learning models. We also report their performances on public benchmark datasets, which can update readers’ understandings of the latest status of automatic math problem solvers.
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Zhihong Shao,Peiyi Wang,Qihao Zhu,Runxin Xu,Junxiao Song,Xiao Bi,Haowei Zhang,Mingchuan Zhang,Y.K. Li,Y. Wu,Daya Guo

2024-04-27

Abstract:Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature. In this paper, we introduce DeepSeekMath 7B, which continues pre-training DeepSeek-Coder-Base-v1.5 7B with 120B math-related tokens sourced from Common Crawl, together with natural language and code data. DeepSeekMath 7B has achieved an impressive score of 51.7% on the competition-level MATH benchmark without relying on external toolkits and voting techniques, approaching the performance level of Gemini-Ultra and GPT-4. Self-consistency over 64 samples from DeepSeekMath 7B achieves 60.9% on MATH. The mathematical reasoning capability of DeepSeekMath is attributed to two key factors: First, we harness the significant potential of publicly available web data through a meticulously engineered data selection pipeline. Second, we introduce Group Relative Policy Optimization (GRPO), a variant of Proximal Policy Optimization (PPO), that enhances mathematical reasoning abilities while concurrently optimizing the memory usage of PPO.

Computation and Language,Artificial Intelligence,Machine Learning
DeepStack: Expert-level artificial intelligence in heads-up no-limit poker

Matej Moravčík,Martin Schmid,Neil Burch,Viliam Lisý,Dustin Morrill,Nolan Bard,Trevor Davis,Kevin Waugh,Michael Johanson,Michael Bowling

DOI: https://doi.org/10.1126/science.aam6960

IF: 56.9

2017-05-05

Science

Abstract:Computer code based on continual problem re-solving beats human professional poker players at a two-player variant of poker.

multidisciplinary sciences
MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

Lei Wang,Dongxiang Zhang,Lianli Gao,Jingkuan Song,Long Guo,Heng Tao Shen

DOI: https://doi.org/10.1609/aaai.v32i1.11981

2018-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Designing an automatic solver for math word problems has been considered as a crucial step towards general AI, with the ability of natural language understanding and logical inference. The state-of-the-art performance was achieved by enumerating all the possible expressions from the quantities in the text and customizing a scoring function to identify the one with the maximum probability. However, it incurs exponential search space with the number of quantities and beam search has to be applied to trade accuracy for efficiency. In this paper, we make the first attempt of applying deep reinforcement learning to solve arithmetic word problems. The motivation is that deep Q-network has witnessed success in solving various problems with big search space and achieves promising performance in terms of both accuracy and running time. To fit the math problem scenario, we propose our MathDQN that is customized from the general deep reinforcement learning framework. Technically, we design the states, actions, reward function, together with a feed-forward neural network as the deep Q-network. Extensive experimental results validate our superiority over state-of-the-art methods. Our MathDQN yields remarkable improvement on most of datasets and boosts the average precision among all the benchmark datasets by 15\%.
Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology

Wei Xie,Shuoyoucheng Ma,Zhenhua Wang,Enze Wang,Kai Chen,Xiaobing Sun,Baosheng Wang

2024-11-15

Abstract:The cognitive mechanism by which Large Language Models (LLMs) solve mathematical problems remains a widely debated and unresolved issue. Currently, there is little interpretable experimental evidence that connects LLMs' problem-solving with human cognitive <a class="link-external link-http" href="http://psychology.To" rel="external noopener nofollow">this http URL</a> determine if LLMs possess human-like mathematical reasoning, we modified the problems used in the human Cognitive Reflection Test (CRT). Our results show that, even with the use of Chains of Thought (CoT) prompts, mainstream LLMs, including the latest o1 model (noted for its reasoning capabilities), have a high error rate when solving these modified CRT problems. Specifically, the average accuracy rate dropped by up to 50% compared to the original <a class="link-external link-http" href="http://questions.Further" rel="external noopener nofollow">this http URL</a> analysis of LLMs' incorrect answers suggests that they primarily rely on pattern matching from their training data, which aligns more with human intuition (System 1 thinking) rather than with human-like reasoning (System 2 thinking). This finding challenges the belief that LLMs have genuine mathematical reasoning abilities comparable to humans. As a result, this work may adjust overly optimistic views on LLMs' progress towards artificial general intelligence.

Artificial Intelligence,Computation and Language,Machine Learning
DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker

Matej Moravčík,Martin Schmid,Neil Burch,Viliam Lisý,Dustin Morrill,Nolan Bard,Trevor Davis,Kevin Waugh,Michael Johanson,Michael Bowling

DOI: https://doi.org/10.1126/science.aam6960

2017-03-04

Abstract:Artificial intelligence has seen several breakthroughs in recent years, with games often serving as milestones. A common feature of these games is that players have perfect information. Poker is the quintessential game of imperfect information, and a longstanding challenge problem in artificial intelligence. We introduce DeepStack, an algorithm for imperfect information settings. It combines recursive reasoning to handle information asymmetry, decomposition to focus computation on the relevant decision, and a form of intuition that is automatically learned from self-play using deep learning. In a study involving 44,000 hands of poker, DeepStack defeated with statistical significance professional poker players in heads-up no-limit Texas hold'em. The approach is theoretically sound and is shown to produce more difficult to exploit strategies than prior approaches.

Artificial Intelligence
Google AI algorithm masters ancient game of Go

Elizabeth Gibney

DOI: https://doi.org/10.1038/529445a

IF: 64.8

2016-01-27

Nature

Abstract:Deep-learning software defeats human professional for first time.

multidisciplinary sciences
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

Haolong Li,Yu Ma,Yinqi Zhang,Chen Ye,Jie Chen

2024-06-04

Abstract:Large Language Models (LLMs) have shown excellent performance in language understanding, text generation, code synthesis, and many other tasks, while they still struggle in complex multi-step reasoning problems, such as mathematical reasoning. In this paper, through a newly proposed arithmetical puzzle problem, we show that the model can perform well on multi-step reasoning tasks via fine-tuning on high-quality synthetic data. Experimental results with the open-llama-3B model on three different test datasets show that not only the model can reach a zero-shot pass@1 at 0.44 on the in-domain dataset, it also demonstrates certain generalization capabilities on the out-of-domain datasets. Specifically, this paper has designed two out-of-domain datasets in the form of extending the numerical range and the composing components of the arithmetical puzzle problem separately. The fine-tuned models have shown encouraging performance on these two far more difficult tasks with the zero-shot pass@1 at 0.33 and 0.35, respectively.

Computation and Language
Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?

Kuei-Chun Kao,Ruochen Wang,Cho-Jui Hsieh

2024-07-07

Abstract:Large Language Models (LLMs) have demonstrated remarkable performance in solving math problems, a hallmark of human intelligence. Despite high success rates on current benchmarks; however, these often feature simple problems with only one or two unknowns, which do not sufficiently challenge their reasoning capacities. This paper introduces a novel benchmark, BeyondX, designed to address these limitations by incorporating problems with multiple unknowns. Recognizing the challenges in proposing multi-unknown problems from scratch, we developed BeyondX using an innovative automated pipeline that progressively increases complexity by expanding the number of unknowns in simpler problems. Empirical study on BeyondX reveals that the performance of existing LLMs, even those fine-tuned specifically on math tasks, significantly decreases as the number of unknowns increases - with a performance drop of up to 70\% observed in GPT-4. To tackle these challenges, we propose the Formulate-and-Solve strategy, a generalized prompting approach that effectively handles problems with an arbitrary number of unknowns. Our findings reveal that this strategy not only enhances LLM performance on the BeyondX benchmark but also provides deeper insights into the computational limits of LLMs when faced with more complex mathematical challenges.

Artificial Intelligence,Computation and Language,Machine Learning
MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

Meng Fang,Xiangpeng Wan,Fei Lu,Fei Xing,Kai Zou

2024-06-26

Abstract:Large language models (LLMs) have significantly advanced natural language understanding and demonstrated strong problem-solving abilities. Despite these successes, most LLMs still struggle with solving mathematical problems due to the intricate reasoning required. This paper investigates the mathematical problem-solving capabilities of LLMs using the newly developed "MathOdyssey" dataset. The dataset includes diverse mathematical problems at high school and university levels, created by experts from notable institutions to rigorously test LLMs in advanced problem-solving scenarios and cover a wider range of subject areas. By providing the MathOdyssey dataset as a resource to the AI community, we aim to contribute to the understanding and improvement of AI capabilities in complex mathematical problem-solving. We conduct benchmarking on open-source models, such as Llama-3 and DBRX-Instruct, and closed-source models from the GPT series and Gemini models. Our results indicate that while LLMs perform well on routine and moderately difficult tasks, they face significant challenges with Olympiad-level problems and complex university-level questions. Our analysis shows a narrowing performance gap between open-source and closed-source models, yet substantial challenges remain, particularly with the most demanding problems. This study highlights the ongoing need for research to enhance the mathematical reasoning of LLMs. The dataset, results, and code are publicly available.

Computation and Language,Artificial Intelligence
Can Large Language Models Play Games? A Case Study of A Self-Play Approach

Hongyi Guo,Zhihan Liu,Yufeng Zhang,Zhaoran Wang

2024-03-09

Abstract:Large Language Models (LLMs) harness extensive data from the Internet, storing a broad spectrum of prior knowledge. While LLMs have proven beneficial as decision-making aids, their reliability is hampered by limitations in reasoning, hallucination phenomenon, and so on. On the other hand, Monte-Carlo Tree Search (MCTS) is a heuristic search algorithm that provides reliable decision-making solutions, achieved through recursive rollouts and self-play. However, the effectiveness of MCTS relies heavily on heuristic pruning and external value functions, particularly in complex decision scenarios. This work introduces an innovative approach that bolsters LLMs with MCTS self-play to efficiently resolve deterministic turn-based zero-sum games (DTZG), such as chess and go, without the need for additional training. Specifically, we utilize LLMs as both action pruners and proxies for value functions without the need for additional training. We theoretically prove that the suboptimality of the estimated value in our proposed method scales with $\tilde{\mathcal O}\Bigl(\frac{|\tilde {\mathcal A}|}{\sqrt{N}} + \epsilon_\mathrm{pruner} + \epsilon_\mathrm{critic}\Bigr)$, where $N$ is the number of simulations, $|\tilde {\mathcal A}|$ is the cardinality of the pruned action space by LLM, and $\epsilon_\mathrm{pruner}$ and $\epsilon_\mathrm{critic}$ quantify the errors incurred by adopting LLMs as action space pruner and value function proxy, respectively. Our experiments in chess and go demonstrate the capability of our method to address challenges beyond the scope of MCTS and improve the performance of the directly application of LLMs.

Artificial Intelligence
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play

David Silver,Thomas Hubert,Julian Schrittwieser,Ioannis Antonoglou,Matthew Lai,Arthur Guez,Marc Lanctot,Laurent Sifre,Dharshan Kumaran,Thore Graepel,Timothy Lillicrap,Karen Simonyan,Demis Hassabis

DOI: https://doi.org/10.1126/science.aar6404

IF: 56.9

2018-12-07

Science

Abstract:One program to rule them all Computers can beat humans at increasingly complex games, including chess and Go. However, these programs are typically constructed for a particular game, exploiting its properties, such as the symmetries of the board on which it is played. Silver et al. developed a program called AlphaZero, which taught itself to play Go, chess, and shogi (a Japanese version of chess) (see the Editorial, and the Perspective by Campbell). AlphaZero managed to beat state-of-the-art programs specializing in these three games. The ability of AlphaZero to adapt to various game rules is a notable step toward achieving a general game-playing system. Science , this issue p. 1140 ; see also pp. 1087 and 1118

multidisciplinary sciences
Pretrained Language Models are Symbolic Mathematics Solvers too!

Kimia Noorbakhsh,Modar Sulaiman,Mahdi Sharifi,Kallol Roy,Pooyan Jamshidi

DOI: https://doi.org/10.48550/arXiv.2110.03501

2023-03-14

Abstract:Solving symbolic mathematics has always been of in the arena of human ingenuity that needs compositional reasoning and recurrence. However, recent studies have shown that large-scale language models such as transformers are universal and surprisingly can be trained as a sequence-to-sequence task to solve complex mathematical equations. These large transformer models need humongous amounts of training data to generalize to unseen symbolic mathematics problems. In this paper, we present a sample efficient way of solving the symbolic tasks by first pretraining the transformer model with language translation and then fine-tuning the pretrained transformer model to solve the downstream task of symbolic mathematics. We achieve comparable accuracy on the integration task with our pretrained model while using around $1.5$ orders of magnitude less number of training samples with respect to the state-of-the-art deep learning for symbolic mathematics. The test accuracy on differential equation tasks is considerably lower comparing with integration as they need higher order recursions that are not present in language translations. We propose the generalizability of our pretrained language model from Anna Karenina Principle (AKP). We pretrain our model with different pairs of language translations. Our results show language bias in solving symbolic mathematics tasks. Finally, we study the robustness of the fine-tuned model on symbolic math tasks against distribution shift, and our approach generalizes better in distribution shift scenarios for the function integration.

Machine Learning,Computation and Language
‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures

Ewen Callaway

DOI: https://doi.org/10.1038/d41586-020-03348-4

IF: 64.8

2020-11-30

Nature

Abstract:An artificial intelligence (AI) network developed by Google AI offshoot DeepMind has made a gargantuan leap in solving one of biology's grandest challenges — determining a protein's 3D shape from its amino-acid sequence.

multidisciplinary sciences
Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers

Sowmya S Sundaram,Sairam Gurajada,Marco Fisichella,Deepak P,Savitha Sam Abraham

DOI: https://doi.org/10.48550/arXiv.2205.15683

2022-05-31

Computation and Language

Abstract:From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we are still miles away from building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last two years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyse why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavour to provide a road-map for future math word problem research.

DeepMind AI outdoes human mathematicians on unsolved problem

DeepMind hits milestone in solving maths problems — AI's next grand challenge

DeepMind AI solves geometry problems at star-student level

AI cracks hard maths

DeepMind AI is a games master

DeepMind AI creates algorithms that sort data faster than those built by people

Deep Learning in Automatic Math Word Problem Solvers

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

DeepStack: Expert-level artificial intelligence in heads-up no-limit poker

MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology

DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker

Google AI algorithm masters ancient game of Go

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?

MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

Can Large Language Models Play Games? A Case Study of A Self-Play Approach

A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play

Pretrained Language Models are Symbolic Mathematics Solvers too!

‘It will change everything’: DeepMind’s AI makes gigantic leap in solving protein structures

Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers