Abstract:Text understanding and reasoning are among the core areas of artificial intelligence. Even a total solution to automatic text understanding and reasoning is still beyond the current techniques, thus it is time to build the stepping stones to solve a more straightforward problem set like question-answering (QA) without ambiguous utterances in the contexts or questions. The reported state-of-the-art approaches to this kind of problem are nearly all connectionist models based on neural networks. Significant progress has even been made in this direction. It is still hard for the pure connectionist models to handle logical reasoning. They generally suffer from the longstanding drawback of poor explainability and sensitivity to data noise and distribution. In this paper, we propose a complementary symbolic approach, GMR (Graph Matching based Reasoner) to QA - it automatically generates reasoning rules in the form of graphs from the training set and uses the generated rules to infer answers to the questions in the test set via graph matching. By employing this symbolic approach, 20 tasks in bAbI are solved with an average accuracy of 99.38%, and it outperforms the state-of-the-art for a real-life QA dataset WikiTableQuestions. After analyzing the accuracy of the basic evaluation indicators, we studied the generalization ability of the model in the paper, including the anti-noise ability, the convergence of the model, the stability of the model, the complexity of the algorithm, and the uncertainty of the parameters. Through comprehensive analysis and comparison, our model is stronger than the neural network model regarding anti-noise interference. Compared with the neural network model, our model performs very well in multi-tasking, and the stability of the model is quite high. The diversity of tasks did not reduce the stability of the model. We have conducted a comprehensive analysis and comparison of the parameter uncertainties. Our model can optimally select parameter configurations and will not cause a sharp drop in performance due to the parameter uncertainties. Finally, we describe the complexity of the GMR method and the optimal configuration of its parameters.

A Graph-Guided Reasoning Approach for Open-ended Commonsense Question Answering

Open-ended Commonsense Reasoning with Unrestricted Answer Scope

Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering

Joint Reasoning with Knowledge Subgraphs for Multiple Choice Question Answering.

Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge

Graph Matching Based Reasoner: A Symbolic Approach to Question Answering

Knowledge-aware adaptive graph network for commonsense question answering

Towards Graph-hop Retrieval and Reasoning in Complex Question Answering over Textual Database

Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answering

OpenCQA: Open-ended Question Answering with Charts

Exploiting Reasoning Chains for Multi-hop Science Question Answering

CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm

Leveraging Knowledge in Multilingual Commonsense Reasoning

Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering

Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

Question-Guided Semantic Dual-Graph Visual Reasoning with Novel Answers.

Self-supervised BGP-graph Reasoning Enhanced Complex KBQA Via SPARQL Generation

Parallel Fusion of Graph and Text with Semantic Enhancement for Commonsense Question Answering

GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering

Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering