Abstract:This paper investigates a new task named Conversational Question Generation (CQG) which is to generate a question based on a passage and a conversation history (i.e., previous turns of question-answer pairs). CQG is a crucial task for developing intelligent agents that can drive question-answering style conversations or test user understanding of a given passage. Towards that end, we propose a new approach named Reinforced Dynamic Reasoning (ReDR) network, which is based on the general encoder-decoder framework but incorporates a reasoning procedure in a dynamic manner to better understand what has been asked and what to ask next about the passage. To encourage producing meaningful questions, we leverage a popular question answering (QA) model to provide feedback and fine-tune the question generator using a reinforcement learning mechanism. Empirical results on the recently released CoQA dataset demonstrate the effectiveness of our method in comparison with various baselines and model variants. Moreover, to show the applicability of our method, we also apply it to create multi-turn question-answering conversations for passages in SQuAD.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is **Conversational Question Generation (CQG)**. Specifically, given a passage and the conversation history (i.e., previous question - answer pairs), the task is to generate the next relevant and coherent question. This task is crucial for developing intelligent agents that can guide question - answering conversations and can be an important part of intelligent social robots or tutoring systems, attracting users or testing students' understanding of a certain topic by asking meaningful questions. ### Main Challenges Compared with traditional automatic question generation tasks, CQG needs to consider not only the given text but also the conversation history, which requires the model to have a deep - level understanding ability to determine what has been asked and what information should be asked next, so as to generate a coherent conversation. ### Solutions To meet these challenges, the author proposes a new framework named **Reinforced Dynamic Reasoning (ReDR)**. The main features of this framework include: 1. **Dynamic Reasoning Mechanism**: Through a multi - layer reasoning process, gradually update the encoded representation to better understand the conversation history and text content. 2. **Reinforcement Learning Mechanism**: Use a popular reading comprehension model (such as DrQA) to predict the answer quality of the generated questions and use it as a reward signal to optimize the question generator, thereby encouraging the generation of more meaningful questions. ### Experimental Verification The author conducted experiments on the CoQA dataset, and the results show that ReDR is significantly superior to the baseline methods in multiple evaluation metrics. In addition, through human evaluation, the questions generated by ReDR also perform well in terms of naturalness, relevance, coherence, information richness and answerability. ### Application Prospects This research not only provides new technical means for developing intelligent conversation systems but also provides a valuable benchmark dataset for future related research. By automatically generating high - quality multi - round question - answer conversations, the cost of constructing large - scale high - quality conversation datasets can be significantly reduced. ### Conclusion In general, this paper provides an effective method for developing intelligent agents that can generate coherent and meaningful conversational questions by introducing the CQG task and the ReDR framework.

Reinforced Dynamic Reasoning for Conversational Question Generation

Dynamic Graph Reasoning for Conversational Open-Domain Question Answering

Answer-driven Deep Question Generation Based on Reinforcement Learning

Consecutive Question Generation via Dynamic Multitask Learning

Generating Relevant and Informative Questions for Open-domain Conversations

CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning

ChainCQG: Flow-Aware Conversational Question Generation

HACAN: a Hierarchical Answer-Aware and Context-Aware Network for Question Generation

Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation

Reinforced Multi-task Approach for Multi-hop Question Generation

Capturing Conversational Interaction for Question Answering Via Global History Reasoning.

CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question Generation

Rad: Reinforced Attention Decoder Model On Question Generation

PCQPR: Proactive Conversational Question Planning with Reflection

Leveraging Context for Neural Question Generation in Open-domain Dialogue Systems.

Knowledge-augmented Self-training of A Question Rewriter for Conversational Knowledge Base Question Answering.

Multi-Hop Reasoning Question Generation and Its Application.

Learning To Ask More: Semi-Autoregressive Sequential Question Generation Under Dual-Graph Interaction

Deep Question Generation Model Based on Dual Attention Guidance

Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation

Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation