Abstract:Recent research has highlighted the importance of mixed-initiative interactions in conversational search. To enable mixed-initiative interactions, information retrieval systems should be able to ask diverse questions, such as information-seeking, clarification, and open-ended ones. QG of open-domain conversational systems aims at enhancing the interactiveness and persistence of human-machine interactions. The task is challenging because of the sparsity of question generation (QG)-specific data in conversations. Current work is limited to single-turn interaction scenarios. We propose a context-enhanced neural question generation (CNQG) model that leverages the conversational context to predict question content and pattern, then perform question decoding. A hierarchical encoder framework is employed to obtain the discourse-level context representation. Based on this, we propose Review and Transit mechanisms to respectively select contextual keywords and predict new topic words to further construct the question content. Conversational context and the predicted question content are used to produce the question pattern, which in turn guides the question decoding process implemented by a recurrent decoder with a joint attention mechanism. To fully utilize the limited QG-specific data to train our question generator, we perform multi-task learning with three auxiliary training objectives, i.e., question pattern prediction, Review , and Transit mechanisms. The required additional labeled data is obtained in a self-supervised way. We also design a weight decaying strategy to adjust the influences of various auxiliary learning tasks. To the best of our acknowledge, we are the first to extend the application of QG to the multi-turn open-domain conversational scenario. Extensive experimental results demonstrate the effectiveness of our proposal and its main components on generating relevant and informative questions, with robust performance for contexts with various lengths.

Rad: Reinforced Attention Decoder Model On Question Generation

Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model

Iterative GNN-based Decoder for Question Generation

Exploring Question-Specific Rewards for Generating Deep Questions

Graph augmented sequence-to-sequence model for neural question generation

Qadg: Generating question–answer-distractors pairs for real examination

Reinforced Dynamic Reasoning for Conversational Question Generation

Joint Learning of Question Answering and Question Generation

Reinforced Multi-task Approach for Multi-hop Question Generation

Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering

Improving Neural Question Generation using Deep Linguistic Representation

Learning To Ask More: Semi-Autoregressive Sequential Question Generation Under Dual-Graph Interaction

Modeling Extractive Question Answering Using Encoder-Decoder Models with Constrained Decoding and Evaluation-Based Reinforcement Learning

Evaluating Rewards for Question Generation Models

A Reinforcement Learning Framework for Natural Question Generation Using Bi-discriminators

NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering

Generating Relevant and Informative Questions for Open-domain Conversations

Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation

Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering

RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

Ask to Understand: Question Generation for Multi-hop Question Answering