Abstract:Machine reading comprehension (MRC) is a challenging task in natural language processing (NLP), which requires machine to determine the corresponding answer to a given passage and question. Whereas, there always exist unanswerable questions in the real world, which poses a new challenge to MRC tasks. Abundant research work has been carried out on the verification mechanism for the answerability of passage-question pairs. However, these researches only focus on its design and implementation, which has limitations in real-world scenarios. Thus, the method proposed in this paper not only verifies the answerability, but also validates and adjusts the predicted answer to obtain an elaborate answer span. Using powerful pre-trained model as encoder block, this paper explores a more comprehensive verification mechanism. Similar to how humans read passages and give answers, we propose a three-stage mechanism called "Verification for an Elaborate Span" (V4ES): 1) sketchy reading that the model briefly browses the overall information of the passage and question, and then generates an initial answer; 2) intensive reading that it reads the passage and question again, judges the answerability of the question and gives an answer at this stage; 3) verification that it verifies these two answers produced at the previous two stages, and then gives the final prediction. Moreover, the proposed model is evaluated on two MRC challenge datasets: SQuAD2.0 and CMRC2018, and the experiment results show that our model has achieved great improvement compared with the ALBERT and BERT baselines. In conclusion, our proposed verification mechanism has demonstrated its effectiveness through a series of experiments and analysis.

Multi-paragraph Reading Comprehension with Token-level Dynamic Reader and Hybrid Verifier

Multi-Matching Network for Multiple Choice Reading Comprehension

Multi-hop Reading Comprehension via Deep Reinforcement Learning based Document Traversal

Multi-Paragraph Machine Reading Comprehension with Hybrid Reader over Tables and Text

M3: A Multi-View Fusion and Multi-Decoding Network for Multi-Document Reading Comprehension.

Mnemonic reader: Machine comprehension with iterative aligning and multi-hop answer pointing

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

Reinforced Mnemonic Reader for Machine Reading Comprehension

Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents

Spans, Not Tokens: A Span-Centric Model for Multi-Span Reading Comprehension

DCMN+: Dual Co-Matching Network for Multi-choice Reading Comprehension

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Verification mechanism to obtain an elaborate answer span in machine reading comprehension

Hybrid Embedding and Joint Training of Stacked Encoder for Opinion Question Machine Reading Comprehension.

APER: AdaPtive Evidence-driven Reasoning Network for machine reading comprehension with unanswerable questions

Read + Verify: Machine Reading Comprehension with Unanswerable Questions

Reinforced Mnemonic Reader for Machine Comprehension

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering

Analysis of English Multitext Reading Comprehension Model Based on Deep Belief Neural Network

S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension