Abstract:Recent research has highlighted the importance of mixed-initiative interactions in conversational search. To enable mixed-initiative interactions, information retrieval systems should be able to ask diverse questions, such as information-seeking, clarification, and open-ended ones. QG of open-domain conversational systems aims at enhancing the interactiveness and persistence of human-machine interactions. The task is challenging because of the sparsity of question generation (QG)-specific data in conversations. Current work is limited to single-turn interaction scenarios. We propose a context-enhanced neural question generation (CNQG) model that leverages the conversational context to predict question content and pattern, then perform question decoding. A hierarchical encoder framework is employed to obtain the discourse-level context representation. Based on this, we propose Review and Transit mechanisms to respectively select contextual keywords and predict new topic words to further construct the question content. Conversational context and the predicted question content are used to produce the question pattern, which in turn guides the question decoding process implemented by a recurrent decoder with a joint attention mechanism. To fully utilize the limited QG-specific data to train our question generator, we perform multi-task learning with three auxiliary training objectives, i.e., question pattern prediction, Review , and Transit mechanisms. The required additional labeled data is obtained in a self-supervised way. We also design a weight decaying strategy to adjust the influences of various auxiliary learning tasks. To the best of our acknowledge, we are the first to extend the application of QG to the multi-turn open-domain conversational scenario. Extensive experimental results demonstrate the effectiveness of our proposal and its main components on generating relevant and informative questions, with robust performance for contexts with various lengths.

Multi-turn dialogue-oriented pretrained question generation model

Teaching Machines to Converse

Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

Multi-Task Learning with Language Modeling for Question Generation

PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable

Deep context modeling for multi-turn response selection in dialogue systems

Generating Relevant and Informative Questions for Open-domain Conversations

GTM: A Generative Triple-Wise Model for Conversational Question Generation

Multi-turn Response Selection with Commonsense-enhanced Language Models

Multi-Domain Dialogue Acts and Response Co-Generation

Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds

Towards Robust Online Dialogue Response Generation

DialogueBERT: A Self-Supervised Learning based Dialogue Pre-training Encoder

DialogBERT: Discourse-Aware Response Generation Via Learning to Recover and Rank Utterances

Extending the Transformer with Context and Multi-dimensional Mechanism for Dialogue Response Generation.

Generative multi-round chat dialogue method and system and computer-readable storage medium

DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

Multi-Turn Video Question Generation Via Reinforced Multi-Choice Attention Network

Multi-turn Dialogue Generation Using Self-attention and Nonnegative Matrix Factorization

Topic-Based Question Generation

Pretrained Language Models for Dialogue Generation with Multiple Input Sources.