Abstract:Question answering (QA) systems for large document collections typically use pipelines that (i) retrieve possibly relevant documents, (ii) re-rank them, (iii) rank paragraphs or other snippets of the top-ranked documents, and (iv) select spans of the top-ranked snippets as exact answers. Pipelines are conceptually simple, but errors propagate from one component to the next, without later components being able to revise earlier decisions. We present an architecture for joint document and snippet ranking, the two middle stages, which leverages the intuition that relevant documents have good snippets and good snippets come from relevant documents. The architecture is general and can be used with any neural text relevance ranker. We experiment with two main instantiations of the architecture, based on POSIT-DRMM (PDRMM) and a BERT-based ranker. Experiments on biomedical data from BIOASQ show that our joint models vastly outperform the pipelines in snippet retrieval, the main goal for QA, with fewer trainable parameters, also remaining competitive in document retrieval. Furthermore, our joint PDRMM-based model is competitive with BERT-based models, despite using orders of magnitude fewer parameters. These claims are also supported by human evaluation on two test batches of BIOASQ. To test our key findings on another dataset, we modified the Natural Questions dataset so that it can also be used for document and snippet retrieval. Our joint PDRMM-based model again outperforms the corresponding pipeline in snippet retrieval on the modified Natural Questions dataset, even though it performs worse than the pipeline in document retrieval. We make our code and the modified Natural Questions dataset publicly available.

Enhancing Document-Based Question Answering via Interaction Between Question Words and POS Tags.

A Joint Model For Question-Answering Over Traditional Chinese Medicine

A Question-Answering System over Traditional Chinese Medicine

A Chinese Intelligent Question Answering System Based on Domain Ontology and Sentence Templates

A Unified Model for Document-Based Question Answering Based on Human-Like Reading Strategy.

Topic enhanced deep structured semantic models for knowledge base question answering

Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering

Novel Knowledge-Based System with Relation Detection and Textual Evidence for Question Answering Research.

Multi-document Question Answering Powered by External Knowledge.

Convolutional Deep Neural Networks for Document-Based Question Answering

A Neural Model for Joint Document and Snippet Ranking in Question Answering for Large Document Collections

Bi-directional Long Short-Term Memory Model with Semantic Positional Attention for the Question Answering System

Exploiting WordNet Synset and Hypernym Representations for Answer Selection.

A framework for intelligent question answering system using semantic context-specific document clustering and Wordnet

A Chinese Question Answering System for Single-Relation Factoid Questions

Bridging the Language Gap: Knowledge Injected Multilingual Question Answering

Pay More Attention - Neural Architectures for Question-Answering

Deep question answering for single documents with lexical chains

Using Context Information to Enhance Simple Question Answering

Hybrid Question Answering over Knowledge Base and Free Text.

Information Extraction from Documents: Question Answering vs Token Classification in real-world setups