Clues Before Answers: Generation-Enhanced Multiple-Choice QA.

Zixian Huang,Ao Wu,Jiaying Zhou,Yu Gu,Yue Zhao,Gong Cheng
DOI: https://doi.org/10.18653/v1/2022.naacl-main.239
2022-01-01
Abstract:A trending paradigm for multiple-choice question answering (MCQA) is using a text-to-text framework. By unifying data in different tasks into a single text-to-text format, it trains a generative encoder-decoder model which is both powerful and universal. However, a side effect of twisting a generation target to fit the classification nature of MCQA is the underutilization of the decoder and the knowledge that can be decoded. To exploit the generation capability and underlying knowledge of a pre-trained encoder-decoder model, in this paper, we propose a generation-enhanced MCQA model named GenMC. It generates a clue from the question and then leverages the clue to enhance a reader for MCQA. It outperforms textto-text models on multiple MCQA datasets.
What problem does this paper attempt to address?