Abstract:Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning remains particularly challenging. To address MH-QA specifically, we propose a Deep Reinforcement Learning based method capable of learning sequential reasoning across large collections of documents so as to pass a query-aware, fixed-size context subset to existing models for answer extraction. Our method is comprised of two stages: a linker, which decomposes the provided support documents into a graph of sentences, and an extractor, which learns where to look based on the current question and already-visited sentences. The result of the linker is a novel graph structure at the sentence level that preserves logical flow while still allowing rapid movement between documents. Importantly, we demonstrate that the sparsity of the resultant graph is invariant to context size. This translates to fewer decisions required from the Deep-RL trained extractor, allowing the system to scale effectively to large collections of documents. The importance of sequential decision making in the document traversal step is demonstrated by comparison to standard IE methods, and we additionally introduce a BM25-based IR baseline that retrieves documents relevant to the query only. We examine the integration of our method with existing models on the recently proposed QAngaroo benchmark and achieve consistent increases in accuracy across the board, as well as a 2-3x reduction in training time.

Retrieve, Read, Rerank: Towards End-To-End Multi-Document Reading Comprehension

Multiple Perspective Answer Reranking for Multi-passage Reading Comprehension.

Multi-hop Reading Comprehension via Deep Reinforcement Learning based Document Traversal

Multi Document Reading Comprehension

MGRC: an End-to-End Multigranularity Reading Comprehension Model for Question Answering

3R: Reading - Ranking - Recognizing for Multi- Passage Reading Comprehension

Reinforced Mnemonic Reader for Machine Comprehension

Multi-paragraph Reading Comprehension with Token-level Dynamic Reader and Hybrid Verifier

Multi-Strategy to Improve Reading Comprehension

Reinforced Mnemonic Reader for Machine Reading Comprehension

R-3: Reinforced Ranker-Reader for Open-Domain Question Answering

Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents

End-to-End Answer Chunk Extraction and Ranking for Reading Comprehension

R$^3$: Reinforced Reader-Ranker for Open-Domain Question Answering

Coarse-to-Fine Document Ranking for Multi-Document Reading Comprehension with Answer-Completion.

Medical Exam Question Answering with Large-scale Reading Comprehension

RoR: Read-over-Read for Long Document Machine Reading Comprehension

Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer

Multi-hop reading comprehension through question decomposition and rescoring

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Multi-Perspective Denoising Reader For Multi-Paragraph Reading Comprehension