Abstract:Machine reading comprehension (MRC) is a challenging task in natural language processing (NLP), which requires machine to determine the corresponding answer to a given passage and question. Whereas, there always exist unanswerable questions in the real world, which poses a new challenge to MRC tasks. Abundant research work has been carried out on the verification mechanism for the answerability of passage-question pairs. However, these researches only focus on its design and implementation, which has limitations in real-world scenarios. Thus, the method proposed in this paper not only verifies the answerability, but also validates and adjusts the predicted answer to obtain an elaborate answer span. Using powerful pre-trained model as encoder block, this paper explores a more comprehensive verification mechanism. Similar to how humans read passages and give answers, we propose a three-stage mechanism called "Verification for an Elaborate Span" (V4ES): 1) sketchy reading that the model briefly browses the overall information of the passage and question, and then generates an initial answer; 2) intensive reading that it reads the passage and question again, judges the answerability of the question and gives an answer at this stage; 3) verification that it verifies these two answers produced at the previous two stages, and then gives the final prediction. Moreover, the proposed model is evaluated on two MRC challenge datasets: SQuAD2.0 and CMRC2018, and the experiment results show that our model has achieved great improvement compared with the ALBERT and BERT baselines. In conclusion, our proposed verification mechanism has demonstrated its effectiveness through a series of experiments and analysis.

I Know There Is No Answer: Modeling Answer Validation for Machine Reading Comprehension

Read + Verify: Machine Reading Comprehension with Unanswerable Questions

How Many Answers Should I Give? an Empirical Study of Multi-Answer Reading Comprehension.

S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension

Verification mechanism to obtain an elaborate answer span in machine reading comprehension

Multi-Matching Network for Multiple Choice Reading Comprehension

U-Net: Machine Reading Comprehension with Unanswerable Questions.

Learn a prior question-aware feature for machine reading comprehension

How Much Reading Does Reading Comprehension Require? A Critical Investigation of Popular Benchmarks

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Automatic Generation of Short Answer Questions for Reading Comprehension Assessment

QuALITY: Question Answering with Long Input Texts, Yes!

Intelligent Question Answering System Based on Machine Reading Comprehension

Analysis of English Multitext Reading Comprehension Model Based on Deep Belief Neural Network

Reinforced Mnemonic Reader for Machine Reading Comprehension

APER: AdaPtive Evidence-driven Reasoning Network for machine reading comprehension with unanswerable questions

Visual Question Answering As Reading Comprehension

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

Towards Confident Machine Reading Comprehension