Abstract:Reading comprehension question generation aims to generate questions from a given article, while distractor generation involves generating multiple distractors from a given article, question, and answer. Most existing research has mainly focused on one of the above tasks, with limited attention to the joint task of Question–Answer-Distractor (QAD) generation. While previous work has achieved success in the joint generation of answer-aware questions and distractors, applying these answer-aware approaches to practical applications in the education domain remains challenging. In this study, we propose a unified and high-performance Question–Answer-Distractors Generation model, named QADG. Our model comprises two components: Question–Answer Generation (QAG) and Distractor Generation (DG). This model is capable of generating Question–Answer pairs based on a given context and then generating distractors based on the context and QA pairs. To address the unconstrained nature of question-and-answer generation in QAG, we employ a key phrase extraction as reported by Willis (in: proceedings of the Sixth ACM Conference on Learning@ Scale, 2019) module to extract key phrases from the article. The extracted key phrases, as the constraints that can be used to match answers. To enhance the quality of distractors, we propose a novel ranking-rewriting mechanism. We employ a fine-tuned model to rank distractors and introduce a rewriting module to improve the quality of distractors. Furthermore, the Knowledge-Dependent-Answerability (KDA) as reported by Moon (Evaluating the knowledge dependency of questions, 2022) is used as a filter to ensure the answerability of the generated QAD pairs. Experiments on SQuAD and RACE datasets demonstrate that the proposed QADG exhibits superior performance, particularly in the DG phase. Additionally, human evaluations also confirm the effectiveness and educational relevance of our model.

Difficulty-aware Distractor Generation for Gap-Fill Items.

Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation

Automatic Distractor Generation for Multiple Choice Questions in Standard Tests

CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model

Generating Distractors for Reading Comprehension Questions from Real Examinations

Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering

DisGeM: Distractor Generation for Multiple Choice Questions with Span Masking

Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding

DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension

Exploring Automated Distractor Generation for Math Multiple-choice Questions via Large Language Models

Learning to Reuse Distractors to support Multiple Choice Question Generation in Education

Assessing Distractors in Multiple-Choice Tests

Qadg: Generating question–answer-distractors pairs for real examination

DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions

Co-Attention Hierarchical Network: Generating Coherent Long Distractors for Reading Comprehension

Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning

Improving Automated Distractor Generation for Math Multiple-choice Questions with Overgenerate-and-rank

Accurate, Diverse and Multiple Distractor Generation with Mixture of Experts.

Good, Better, Best: Textual Distractors Generation for Multiple-Choice Visual Question Answering via Reinforcement Learning

Automatic distractor generation in multiple-choice questions: a systematic literature review

Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration