Abstract:Recent research has highlighted the importance of mixed-initiative interactions in conversational search. To enable mixed-initiative interactions, information retrieval systems should be able to ask diverse questions, such as information-seeking, clarification, and open-ended ones. QG of open-domain conversational systems aims at enhancing the interactiveness and persistence of human-machine interactions. The task is challenging because of the sparsity of question generation (QG)-specific data in conversations. Current work is limited to single-turn interaction scenarios. We propose a context-enhanced neural question generation (CNQG) model that leverages the conversational context to predict question content and pattern, then perform question decoding. A hierarchical encoder framework is employed to obtain the discourse-level context representation. Based on this, we propose Review and Transit mechanisms to respectively select contextual keywords and predict new topic words to further construct the question content. Conversational context and the predicted question content are used to produce the question pattern, which in turn guides the question decoding process implemented by a recurrent decoder with a joint attention mechanism. To fully utilize the limited QG-specific data to train our question generator, we perform multi-task learning with three auxiliary training objectives, i.e., question pattern prediction, Review , and Transit mechanisms. The required additional labeled data is obtained in a self-supervised way. We also design a weight decaying strategy to adjust the influences of various auxiliary learning tasks. To the best of our acknowledge, we are the first to extend the application of QG to the multi-turn open-domain conversational scenario. Extensive experimental results demonstrate the effectiveness of our proposal and its main components on generating relevant and informative questions, with robust performance for contexts with various lengths.

Pick the Better and Leave the Rest: Leveraging Multiple Retrieved Results to Guide Response Generation

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

A Hybrid Chinese Conversation Model Based on Retrieval and Generation.

A Hybrid Retrieval-Generation Neural Conversation Model.

Multi-Response Awareness for Retrieval-Based Conversations: Respond with Diversity Via Dynamic Representation Learning

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

Generating Relevant and Informative Questions for Open-domain Conversations

Retrieval-Enhanced Adversarial Training for Neural Response Generation

An Ensemble of Retrieval-Based and Generation-Based Human-Computer Conversation Systems

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System

RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generation

Group Linguistic Bias Aware Neural Response Generation.

Retrieval is Accurate Generation

Promoting Diversity for End-to-End Conversation Response Generation.

Two Are Better Than One: an Ensemble of Retrieval- and Generation-Based Dialog Systems.

Generating Diverse Conversation Responses by Creating and Ranking Multiple Candidates

A Systematic Investigation of Knowledge Retrieval and Selection for Retrieval Augmented Generation

Open Domain Response Generation Guided by Retrieved Conversations

Toward Explainable Dialogue System Using Two-stage Response Generation.

Neural response generation for task completion using conversational knowledge graph

Towards a Neural Conversation Model With Diversity Net Using Determinantal Point Processes.