Abstract:Developing automatic Math Word Problem (MWP) solvers is a challenging task that demands the ability of understanding and mathematical reasoning over the natural language. Recent neural-based approaches mainly encode the problem text using a language model and decode a mathematical expression over quantities and operators iteratively. Note the problem text of a MWP consists of a context part and a question part, a recent work finds these neural solvers may only perform shallow pattern matching between the context text and the golden expression, where question text is not well used. Meanwhile, existing decoding processes fail to enforce the mathematical laws into the design, where the representations for mathematical equivalent expressions are different. To address these two issues, we propose a new encoder-decoder architecture that fully leverages the question text and preserves step-wise commutative law. Besides generating quantity embeddings, our encoder further encodes the question text and uses it to guide the decoding process. At each step, our decoder uses Deep Sets to compute expression representations so that these embeddings are invariant under any permutation of quantities. Experiments on four established benchmarks demonstrate that our framework outperforms state-of-the-art neural MWP solvers, showing the effectiveness of our techniques. We also conduct a detailed analysis of the results to show the limitations of our approach and further discuss the potential future work. Code is available at https://github.com/sophistz/Question-Aware-Deductive-MWP.

Problem-guided Neural Math Problem Solvers.

Techniques to Improve Neural Math Word Problem Solvers

Deep Learning in Automatic Math Word Problem Solvers

MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers

MWPToolkit: an Open-Source Framework for Deep Learning-Based Math Word Problem Solvers.

Compositional Mathematical Encoding for Math Word Problems

Non-Autoregressive Math Word Problem Solver with Unified Tree Structure

Tackling Math Word Problems with Fine-to-Coarse Abstracting and Reasoning

A Goal-Driven Tree-Structured Neural Model for Math Word Problems

DISK: Domain-constrained Instance Sketch for Math Word Problem Generation

Enhancing Seq2seq Math Word Problem Solver with Entity Information and Math Knowledge

Are NLP Models really able to Solve Simple Math Word Problems?

Tree-structured Decoding for Solving MathWord Problems

Structure-Unified M-Tree Coding Solver for Math Word Problem

Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems

Math Word Problem Solving by Generating Linguistic Variants of Problem Statements

Explaining Math Word Problem Solvers

The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solvers

Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems

Solving Math Word Problem with Problem Type Classification

Neural Mathematical Solver with Enhanced Formula Structure