Abstract:Reasoning answers to mathematical problems requires machines to think and operate like a human to learn knowledge from mathematical data, which is one of the fundamental tasks for exploring general artificial intelligence. Most solutions focus on mimicking how humans understand problems, which generate the necessary expressions for answers. However, they are still far from enough since they ignore the core ability of humans to acquire knowledge from experience. In this paper, we propose a Cognitive Solver (CogSolver) that is capable of autonomously learning knowledge from scratch to solve mathematical problems, inspired by two cognitive science theories. Specifically, we draw one insight from the dual process theory to establish an intelligent BRAIN-ARM framework, and refer to another information processing theory to summarize the knowledge learning process into Store-Apply-Update steps. In CogSolver, the BRAIN system stores three types of mathematical knowledge, including semantics knowledge, relation knowledge, and mathematic rule knowledge. Then, the ARM system applies the knowledge in BRAIN to answer the problems. Specifically, we design a knowledge-aware module and a commutative module in ARM to improve its reasoning ability, where the knowledge is organically integrated into answer reasoning process. After solving the problems, BRAIN updates the stored knowledge according to the feedback of ARM, where we develop knowledge filters to eliminate the redundant ones and further form a more reasonable knowledge base. Our CogSolver carries out the above three steps iteratively, which behaves more like a human. We conduct extensive experiments on real-world math word problem datasets. The experimental results demonstrate the improvement in answer reasoning and clearly show how CogSolver gains knowledge from the problems, leading to superior interpretability. Our codes are available at https://github.com/bigdata-ustc/CogSolver.

MILE: Memory-Interactive Learning Engine for Neuro-Symbolic Solutions to Mathematical Problems

Neural Mathematical Solver with Enhanced Formula Structure

Recall and Learn: A Memory-augmented Solver for Math Word Problems

Techniques to Improve Neural Math Word Problem Solvers

MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection

Enhancing Seq2seq Math Word Problem Solver with Entity Information and Math Knowledge

Brain-Inspired Two-Stage Approach: Enhancing Mathematical Reasoning by Imitating Human Thought Processes

Deep Learning in Automatic Math Word Problem Solvers

Specialized Mathematical Solving by a Step-By-Step Expression Chain Generation

Solving Math Word Problems by Combining Language Models With Symbolic Solvers

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

Guiding Mathematical Reasoning Via Mastering Commonsense Formula Knowledge

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

Multi-tool Integration Application for Math Reasoning Using Large Language Model

AI-Assisted Generation of Difficult Math Questions

A Cognitive Solver with Autonomously Knowledge Learning for Reasoning Mathematical Answers

Neuro-Symbolic Data Generation for Math Reasoning

An Artificial Neuron for Enhanced Problem Solving in Large Language Models

MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning