Abstract:Dialogue-based multiple-choice machine reading comprehension (MRC) is one of most difficult and novel tasks because it requires more advanced reading comprehension skills, such as speaker’s intention analysis, non-extractive reasoning, commonsense knowledge. Previous models usually only compute attention scores from the fixed representation of entire dialogue, and also do not fully consider the contribution of dialogue, question, options, and their combinations respectively. In this paper, we introduce Utterance-focusing Multiway-matching Network (UMN), a simple but effective human mimicking model for dialogue-based multiple-choice MRC. First, two utterance-focusing mechanisms called ParaUF and AutoUF are proposed to extract the utterances that are most relevant to the question and option: ParaUF gets the bilinear weighted distance between each utterance of dialogue and question and option during training while AutoUF obtains the scores by the relevance, overlap and coverage (ROC) rules before training process. Second, we adopted the multiway-matching mechanism to capture the relationship among the question, option and selected utterances through calculating the attention weights between the quadruplet of four sequences: utterances, question, option and the concatenation of each two. We evaluate the proposed model on dialogue-based multiple-choice MRC tasks, DREAM, and outperformed recently published methods under the same pre-trained model. A series of detailed analysis is also conducted to interpret the differences of two utterance-focusing mechanisms and the effectiveness of the proposed multiway-matching mechanism.

Transfer Learning Enhanced Single-choice Decision for Multi-choice Question Answering

MMM: Multi-stage Multi-task Learning for Multi-choice Reading Comprehension

Multi-Matching Network for Multiple Choice Reading Comprehension

Multi-choice Dialogue-Based Reading Comprehension with Knowledge and Key Turns.

Multi-Passage Machine Reading Comprehension Through Multi-Task Learning and Dual Verification

Machine Reading Comprehension for Continuous Questions Via Multi-Task Learning

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Incorporating Option and Out-of-domain Knowledge for Multi-choice Machine Reading Comprehension

Multi-Task Learning with Generative Adversarial Training for Multi-Passage Machine Reading Comprehension

Multi-source Meta Transfer for Low Resource Multiple-Choice Question Answering.

Exploiting Diverse Information in Pre-Trained Language Model for Multi-Choice Machine Reading Comprehension

Feeding What You Need by Understanding What You Learned

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Multi-task Transfer Learning for Biomedical Machine Reading Comprehension.

Intelligent Question Answering System Based on Machine Reading Comprehension

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

Residual Connection-Based Multi-Step Reasoning Via Commonsense Knowledge For Multiple Choice Machine Reading Comprehension

Dual Multi-head Co-attention for Multi-choice Reading Comprehension.

Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions

Utterance-focusing Multiway-Matching Network for Dialogue-Based Multiple-Choice Machine Reading Comprehension

DCMN+: Dual Co-Matching Network for Multi-choice Reading Comprehension