Mapping to Declarative Knowledge for Word Problem Solving

Subhro Roy,Dan Roth

DOI: https://doi.org/10.48550/arXiv.1712.09391

2017-12-27

Abstract:Math word problems form a natural abstraction to a range of quantitative reasoning problems, such as understanding financial news, sports results, and casualties of war. Solving such problems requires the understanding of several mathematical concepts such as dimensional analysis, subset relationships, etc. In this paper, we develop declarative rules which govern the translation of natural language description of these concepts to math expressions. We then present a framework for incorporating such declarative knowledge into word problem solving. Our method learns to map arithmetic word problem text to math expressions, by learning to select the relevant declarative knowledge for each operation of the solution expression. This provides a way to handle multiple concepts in the same problem while, at the same time, support interpretability of the answer expression. Our method models the mapping to declarative knowledge as a latent variable, thus removing the need for expensive annotations. Experimental evaluation suggests that our domain knowledge based solver outperforms all other systems, and that it generalizes better in the realistic case where the training data it is exposed to is biased in a different way than the test data.

Computation and Language

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to map mathematical concepts described in natural language to mathematical expressions, thereby solving mathematical word problems. Specifically, the author has developed a set of declarative rules to guide this transformation and proposed a framework to incorporate this declarative knowledge into the solutions of mathematical word problems. The core of the method lies in learning how to select appropriate declarative knowledge related to each operation in the problem - solving expression, which can not only handle multiple concepts in the same problem, but also improve the interpretability of the answer expression. In addition, this method reduces the need for expensive annotations by modeling the selection of declarative knowledge as latent variables. Experimental evaluations show that the solver based on domain knowledge outperforms other systems and has better generalization ability in cases where the deviation between training data and test data is different.