Abstract:Machine Reading Comprehension (MRC) is one of the most challenging tasks in both NLP and IR researches. Recently, a number of deep neural models have been successfully adopted to some simplified MRC task settings, whose performances were close to or even better than human beings. However, these models still have large performance gaps with human beings in more practical settings, such as MS MARCO and DuReader datasets. Although there are many works studying human reading behavior, the behavior patterns in complex reading comprehension scenarios remain under-investigated. We believe that a better understanding of how human reads and allocates their attention during reading comprehension processes can help improve the performance of MRC tasks. In this paper, we conduct a lab study to investigate human's reading behavior patterns during reading comprehension tasks, where 32 users are recruited to take 60 distinct tasks. By analyzing the collected eye-tracking data and answers from participants, we propose a two-stage reading behavior model, in which the first stage is to search for possible answer candidates and the second stage is to generate the final answer through a comparison and verification process. We also find that human's attention distribution is affected by both question-dependent factors (e.g., answer and soft matching signal with questions) and question-independent factors (e.g., position, IDF and Part-of-Speech tags of words). We extract features derived from the two-stage reading behavior model to predict human's attention signals during reading comprehension, which significantly improves performance in the MRC task. Findings in our work may bring insight into the understanding of human reading and information seeking processes, and help the machine to better meet users' information needs.

Relation Module for Non-Answerable Predictions on Reading Comprehension.

Entity-Relation Extraction As Multi-Turn Question Answering

Tuning N-ary Relation Extraction As Machine Reading Comprehension

Feeding What You Need by Understanding What You Learned

APER: AdaPtive Evidence-driven Reasoning Network for machine reading comprehension with unanswerable questions

Learn a prior question-aware feature for machine reading comprehension

Improving the robustness of machine reading comprehension model with hierarchical knowledge and auxiliary unanswerability prediction

Chinese Machine Reading Comprehension Based on Language Model Containing Knowledge.

Hybrid Embedding and Joint Training of Stacked Encoder for Opinion Question Machine Reading Comprehension.

A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension.

Plug-and-Play Module for Commonsense Reasoning in Machine Reading Comprehension

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification.

Read, Attend, and Exclude: Multi-Choice Reading Comprehension by Mimicking Human Reasoning Process

Verification mechanism to obtain an elaborate answer span in machine reading comprehension

Human Behavior Inspired Machine Reading Comprehension

Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension

Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension

Towards Confident Machine Reading Comprehension

Reinforced Mnemonic Reader for Machine Reading Comprehension

Relation-Guided Pre-Training for Open-Domain Question Answering