Abstract:Multiple-choice Machine Comprehension (MC) is an important and challenging nature language processing (NLP) task where the machine is required to make the best answer from candidate answer set given particular passage and question. Existing approaches either only utilize the powerful pre-trained language models or only rely on an over complicated matching network that is design supposed to capture the relationship effectively among the triplet of passage, question and candidate answers. In this paper, we present a novel architecture, Dual Head-wise Coattention network (called DHC), which is a simple and efficient attention neural network designed to perform multiple-choice MC task. Our proposed DHC not only support a powerful pre-trained language model as encoder, but also models the MC relationship as attention mechanism straightforwardly, by head-wise matching and aggregating method on multiple layers, which better model relationships sufficiently between question and passage, and cooperate with large pre-trained language models more efficiently. To evaluate the performance, we test our proposed model on five challenging and well-known datasets for multiple-choice MC: RACE, DREAM, SemEval-2018 Task 11, OpenBookQA, and TOEFL. Extensive experimental results demonstrate that our proposal can achieve a significant increase in accuracy comparing existing models based on all five datasets, and it consistently outperforms all tested baselines including the state-of-the-arts techniques. More remarkably, our proposal is a pluggable and more flexible model, and it thus can be plugged into any pre-trained Language Models based on BERT. Ablation studies demonstrate its state-of-the-art performance and generalization.

DTC: Transfer Learning for Commonsense Machine Comprehension

TT-Net: Topic Transfer-Based Neural Network for Conversational Reading Comprehension.

CAT-BERT: A Context-Aware Transferable BERT Model for Multi-turn Machine Reading Comprehension.

Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension

Feeding What You Need by Understanding What You Learned

Hierarchical Conversation Flow Transition and Reasoning for Conversational Machine Comprehension.

Multi-component transfer metric learning for handling unrelated source domain samples

Multi-task Transfer Learning for Biomedical Machine Reading Comprehension.

Gated Convolutional Networks For Commonsense Machine Comprehension

Dual Head-wise Coattention Network for Machine Comprehension with Multiple-Choice Questions

Transfer Learning Enhanced Single-choice Decision for Multi-choice Question Answering

Cross-Domain Traffic Scene Understanding: A Dense Correspondence-Based Transfer Learning Approach

Incremental BERT with Commonsense Representations for Multi-Choice Reading Comprehension

Unsupervised Story Comprehension With Hierarchical Encoder-Decoder

Deep Semantic Mapping for Heterogeneous Multimedia Transfer Learning Using Co-Occurrence Data

Teaching Machine Comprehension with Compositional Explanations

Enhancing Transformer-based language models with commonsense representations for knowledge-driven machine comprehension

Commonsense Knowledge Transfer for Pre-trained Language Models

DCMN+: Dual Co-Matching Network for Multi-choice Reading Comprehension

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension.