Structured Knowledge Grounding for Question Answering

Yujie Lu,Siqi Ouyang,Kairui Zhou

DOI: https://doi.org/10.48550/arXiv.2209.08284

2023-06-06

Abstract:Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include knowledge graphs (KG) to complement LMs with their more logic-driven implicit knowledge. However, effectively extracting information from structured data, like KGs, empowers LMs to remain an open question, and current models rely on graph techniques to extract knowledge. In this paper, we propose to solely leverage the LMs to combine the language and knowledge for knowledge based question-answering with flexibility, breadth of coverage and structured reasoning. Specifically, we devise a knowledge construction method that retrieves the relevant context with a dynamic hop, which expresses more comprehensivenes than traditional GNN-based techniques. And we devise a deep fusion mechanism to further bridge the information exchanging bottleneck between the language and the knowledge. Extensive experiments show that our model consistently demonstrates its state-of-the-art performance over CommensenseQA benchmark, showcasing the possibility to leverage LMs solely to robustly ground QA into the knowledge base.

Computation and Language

What problem does this paper attempt to address?

This paper aims to solve how to use language models (LMs) to perform knowledge - based question - answering (QA) tasks in knowledge bases, especially how to combine language and knowledge through the capabilities of language models themselves to achieve flexible, wide - coverage and structured reasoning. Specifically, the paper proposes a new method that uses only language models to fuse language and knowledge, in order to overcome the limitations of existing methods that use graph neural networks (GNNs) to extract information from structured data (such as knowledge graphs).

The main contributions of the paper include:
- Proposing a new method that uses only language models to fuse two knowledge sources (language models and knowledge graphs).
- Converting knowledge - graph data into a natural - language format and then running the language model to obtain knowledge embeddings of the knowledge graph.
- Achieving results comparable to the existing state - of - the - art methods on public QA benchmarks (such as CommonsenseQA and OpenbookQA).

Through this method, the paper demonstrates the possibility of effectively rooting question - answering tasks in knowledge bases relying only on language models, providing a new direction for future related research.