Abstract:Recent research has highlighted the importance of mixed-initiative interactions in conversational search. To enable mixed-initiative interactions, information retrieval systems should be able to ask diverse questions, such as information-seeking, clarification, and open-ended ones. QG of open-domain conversational systems aims at enhancing the interactiveness and persistence of human-machine interactions. The task is challenging because of the sparsity of question generation (QG)-specific data in conversations. Current work is limited to single-turn interaction scenarios. We propose a context-enhanced neural question generation (CNQG) model that leverages the conversational context to predict question content and pattern, then perform question decoding. A hierarchical encoder framework is employed to obtain the discourse-level context representation. Based on this, we propose Review and Transit mechanisms to respectively select contextual keywords and predict new topic words to further construct the question content. Conversational context and the predicted question content are used to produce the question pattern, which in turn guides the question decoding process implemented by a recurrent decoder with a joint attention mechanism. To fully utilize the limited QG-specific data to train our question generator, we perform multi-task learning with three auxiliary training objectives, i.e., question pattern prediction, Review , and Transit mechanisms. The required additional labeled data is obtained in a self-supervised way. We also design a weight decaying strategy to adjust the influences of various auxiliary learning tasks. To the best of our acknowledge, we are the first to extend the application of QG to the multi-turn open-domain conversational scenario. Extensive experimental results demonstrate the effectiveness of our proposal and its main components on generating relevant and informative questions, with robust performance for contexts with various lengths.

A Neural Question Generation System Based on Knowledge Base.

Large-Scale Simple Question Generation by Template-Based Seq2seq Learning.

Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpus

Toward Subgraph-Guided Knowledge Graph Question Generation With Graph Neural Networks

How Question Generation Can Help Question Answering over Knowledge Base

BB-KBQA: BERT-Based Knowledge Base Question Answering

Learning to Generate Questions by Learning What not to Generate

Neural Question Generation with Answer Pivot

A Chinese Intelligent Question Answering System Based on Domain Ontology and Sentence Templates

Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss

Improving Neural Question Generation using Deep Linguistic Representation

PathQG: Neural Question Generation from Facts

LFKQG: A Controlled Generation Framework with Local Fine-tuning for Question Generation over Knowledge Bases.

Topic-Based Question Generation

A Survey on Neural Question Generation: Methods, Applications, and Prospects

Extended Answer and Uncertainty Aware Neural Question Generation

ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models

Generating Relevant and Informative Questions for Open-domain Conversations

In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models

A Chinese Question Answering System for Single-Relation Factoid Questions

A Review of Deep Learning in Question Answering over Knowledge Bases