Abstract:Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning remains particularly challenging. To address MH-QA specifically, we propose a Deep Reinforcement Learning based method capable of learning sequential reasoning across large collections of documents so as to pass a query-aware, fixed-size context subset to existing models for answer extraction. Our method is comprised of two stages: a linker, which decomposes the provided support documents into a graph of sentences, and an extractor, which learns where to look based on the current question and already-visited sentences. The result of the linker is a novel graph structure at the sentence level that preserves logical flow while still allowing rapid movement between documents. Importantly, we demonstrate that the sparsity of the resultant graph is invariant to context size. This translates to fewer decisions required from the Deep-RL trained extractor, allowing the system to scale effectively to large collections of documents. The importance of sequential decision making in the document traversal step is demonstrated by comparison to standard IE methods, and we additionally introduce a BM25-based IR baseline that retrieves documents relevant to the query only. We examine the integration of our method with existing models on the recently proposed QAngaroo benchmark and achieve consistent increases in accuracy across the board, as well as a 2-3x reduction in training time.

Multiple Perspective Answer Reranking for Multi-passage Reading Comprehension.

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

How Many Answers Should I Give? an Empirical Study of Multi-Answer Reading Comprehension.

Multi-Matching Network for Multiple Choice Reading Comprehension

Effects of cytochalasin B on glycogen metabolism in phagocytizing human polymorphonuclear leukocytes

Multi Document Reading Comprehension

Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents

Retrospective Reader for Machine Reading Comprehension

CAT-BERT: A Context-Aware Transferable BERT Model for Multi-turn Machine Reading Comprehension.

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Read, Attend, and Exclude: Multi-Choice Reading Comprehension by Mimicking Human Reasoning Process

Feeding What You Need by Understanding What You Learned

Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information

MA-MRC: A Multi-answer Machine Reading Comprehension Dataset

Multi-hop Reading Comprehension via Deep Reinforcement Learning based Document Traversal

A Multi-Task Learning Machine Reading Comprehension Model for Noisy Document (student Abstract)

Answering Open-Domain Multi-Answer Questions Via a Recall-then-Verify Framework.

MMM: Multi-stage Multi-task Learning for Multi-choice Reading Comprehension

Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions