An Attention Mechanism for Answer Selection Using a Combined Global and Local View

Yoram Bachrach,Andrej Zukov-Gregoric,Sam Coope,Ed Tovell,Bogdan Maksak,Jose Rodriguez,Conan McMurtie
DOI: https://doi.org/10.48550/arXiv.1707.01378
2017-09-20
Abstract:We propose a new attention mechanism for neural based question answering, which depends on varying granularities of the input. Previous work focused on augmenting recurrent neural networks with simple attention mechanisms which are a function of the similarity between a question embedding and an answer embeddings across time. We extend this by making the attention mechanism dependent on a global embedding of the answer attained using a separate network. We evaluate our system on InsuranceQA, a large question answering dataset. Our model outperforms current state-of-the-art results on InsuranceQA. Further, we visualize which sections of text our attention mechanism focuses on, and explore its performance across different parameter settings.
Computation and Language
What problem does this paper attempt to address?