Abstract:Multiple-choice Machine Comprehension (MC) is an important and challenging nature language processing (NLP) task where the machine is required to make the best answer from candidate answer set given particular passage and question. Existing approaches either only utilize the powerful pre-trained language models or only rely on an over complicated matching network that is design supposed to capture the relationship effectively among the triplet of passage, question and candidate answers. In this paper, we present a novel architecture, Dual Head-wise Coattention network (called DHC), which is a simple and efficient attention neural network designed to perform multiple-choice MC task. Our proposed DHC not only support a powerful pre-trained language model as encoder, but also models the MC relationship as attention mechanism straightforwardly, by head-wise matching and aggregating method on multiple layers, which better model relationships sufficiently between question and passage, and cooperate with large pre-trained language models more efficiently. To evaluate the performance, we test our proposed model on five challenging and well-known datasets for multiple-choice MC: RACE, DREAM, SemEval-2018 Task 11, OpenBookQA, and TOEFL. Extensive experimental results demonstrate that our proposal can achieve a significant increase in accuracy comparing existing models based on all five datasets, and it consistently outperforms all tested baselines including the state-of-the-arts techniques. More remarkably, our proposal is a pluggable and more flexible model, and it thus can be plugged into any pre-trained Language Models based on BERT. Ablation studies demonstrate its state-of-the-art performance and generalization.

Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension

Multi-Matching Network for Multiple Choice Reading Comprehension

MGRC: an End-to-End Multigranularity Reading Comprehension Model for Question Answering

Asynchronous Multi-grained Graph Network for Interpretable Multi-hop Reading Comprehension

A Hierarchical Iterative Attention Model for Machine Comprehension.

A Multi-Task Learning Machine Reading Comprehension Model for Noisy Document (student Abstract)

M3: A Multi-View Fusion and Multi-Decoding Network for Multi-Document Reading Comprehension.

Multi-Task Deep Neural Networks for Multi-Document Reading Comprehension

Multimodal Pre-Training Based on Graph Attention Network for Document Understanding

Towards Reading Comprehension for Long Documents

Retrieve, Read, Rerank: Towards End-To-End Multi-Document Reading Comprehension

Multi-hop Reading Comprehension via Deep Reinforcement Learning based Document Traversal

TGAT-DGL: Triple Graph Attention Networks on Dual-Granularity Level for Multi-party Dialogue Reading Comprehension

Discovering Multimodal Hierarchical Structures with Graph Neural Networks for Multi-modal and Multi-hop Question Answering.

How Many Answers Should I Give? an Empirical Study of Multi-Answer Reading Comprehension.

Multi-hop Question Answering for SRLGRN Augmented by Textual Relationship Modelling

Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs

Dual Head-wise Coattention Network for Machine Comprehension with Multiple-Choice Questions

Multi-hop Reading Comprehension Learning Method Based on Answer Contrastive Learning.

Multi-hop Reading Comprehension Across Documents with Path-based Graph Convolutional Network

ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks