Bi-directional Cognitive Thinking Network for Machine Reading Comprehension

Wei Peng,Yue Hu,Luxi Xing,Yuqiang Xie,Jing Yu,Yajing Sun,Xiangpeng Wei
DOI: https://doi.org/10.48550/arXiv.2010.10286
2020-10-20
Computation and Language
Abstract:We propose a novel Bi-directional Cognitive Knowledge Framework (BCKF) for reading comprehension from the perspective of complementary learning systems theory. It aims to simulate two ways of thinking in the brain to answer questions, including reverse thinking and inertial thinking. To validate the effectiveness of our framework, we design a corresponding Bi-directional Cognitive Thinking Network (BCTN) to encode the passage and generate a question (answer) given an answer (question) and decouple the bi-directional knowledge. The model has the ability to reverse reasoning questions which can assist inertial thinking to generate more accurate answers. Competitive improvement is observed in DuReader dataset, confirming our hypothesis that bi-directional knowledge helps the QA task. The novel framework shows an interesting perspective on machine reading comprehension and cognitive science.
What problem does this paper attempt to address?