Abstract:Social media produces large amounts of contents every day. How to predict the potential influences of the contents from a social reply feedback perspective is a key issue that has not been explored. Thus, we propose a novel task named reply keyword prediction in social media, which aims to predict the keywords in the potential replies as many aspects as possible. One prerequisite challenge is that the accessible social media datasets labeling such keywords remain absent. To solve this issue, we propose a new dataset, to study the reply keyword prediction in Social Media. This task could be seen as a single-turn dialogue keyword prediction for open-domain dialogue system. However, existing methods for dialogue keyword prediction cannot be adopted directly, which have two main drawbacks. First, they do not provide an explicit mechanism to model topic complementarity between keywords which is crucial in social media to controllably model all aspects of replies. Second, the collocations of keywords are not explicitly modeled, which also makes it less controllable to optimize for fine-grained prediction since the context information is much less than that in dialogue. To address these issues, we propose a two-stage disentangled framework, which can optimize the complementarity and collocation explicitly in a disentangled fashion. In the first stage, we use a sequence-to-set paradigm via multi-label prediction and determinantal point processes, to generate a set of keyword seeds satisfying the complementarity. In the second stage, we adopt a set-to-sequence paradigm via seq2seq model with the keyword seeds guidance from the set, to generate the more-fine-grained keywords with collocation. Experiments show that this method can generate not only a more diverse set of keywords but also more relevant and consistent keywords. Furthermore, the keywords obtained based on this method can achieve better reply generation results in the retrieval-based system than others.

Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems.

Open Domain Response Generation Guided by Retrieved Conversations

Keyword-Guided Neural Conversational Model

Keyword-Aware Transformers Network for Chinese Open-Domain Conversation Generation

Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems

Neural Response Generation with Meta-Words

Seq2Set2Seq: A Two-stage Disentangled Method for Reply Keyword Generation in Social Media via Multi-label Prediction and Determinantal Point Processes

Generating Diverse Conversation Responses by Creating and Ranking Multiple Candidates

Neural Response Generation with Dynamic Vocabularies

Towards Robust Online Dialogue Response Generation

Dynamic Knowledge Routing Network For Target-Guided Open-Domain Conversation

A Survey on Response Selection for Retrieval-based Dialogues.

An In-depth Investigation of User Response Simulation for Conversational Search.

Personalized Response Generation by Dual-learning Based Domain Adaptation.

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization

Neural Response Generation with Relevant Emotions for Short Text Conversation

Smarter Response with Proactive Suggestion: a New Generative Neural Conversation Paradigm

Promoting Diversity for End-to-End Conversation Response Generation.

Emotion-and-knowledge grounded response generation in an open-domain dialogue setting

Prediction, selection, and generation: a knowledge-driven conversation system