Abstract:Information-seeking conversation systems are increasingly popular in real-world applications, especially for e-commerce companies. To retrieve appropriate responses for users, it is necessary to compute the matching degrees between candidate responses and users' queries with historical dialogue utterances. As the contexts are usually much longer than responses, it is thus necessary to expand the responses (usually short) with richer information. Recent studies on pseudo-relevance feedback (PRF) have demonstrated its effectiveness in query expansion for search engines, hence we consider expanding response using PRF information. However, existing PRF approaches are either based on heuristic rules or require heavy manual labeling, which are not suitable for solving our task. To alleviate this problem, we treat the PRF selection for response expansion as a learning task and propose a reinforced learning method that can be trained in an end-to-end manner without any human annotations. More specifically, we propose a reinforced selector to extract useful PRF terms to enhance response candidates and a BERT-based response ranker to rank the PRF-enhanced responses. The performance of the ranker serves as a reward to guide the selector to extract useful PRF terms, which boosts the overall task performance. Extensive experiments on both standard benchmarks and commercial datasets prove the superiority of our reinforced PRF term selector compared with other potential soft or hard selection methods. Both case studies and quantitative analysis show that our model is capable of selecting meaningful PRF terms to expand response candidates and also achieving the best results compared with all baselines on a variety of evaluation metrics. We have also deployed our method on online production in an e-commerce company, which shows a significant improvement over the existing online ranking system.

Adapting User Preference to Online Feedback in Multi-round Conversational Recommendation

Learning to Infer User Implicit Preference in Conversational Recommendation

Modeling User’s Neutral Feedback in Conversational Recommendation

User-Centric Conversational Recommendation with Multi-Aspect User Modeling

Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems

DeepCPR: Deep Path Reasoning using Sequence of User-Preferred Attributes for Conversational Recommendation

Interactive Path Reasoning on Graph for Conversational Recommendation

Feedback Reciprocal Graph Collaborative Filtering

Constrained Preference Embedding for Item Recommendation.

UCRI: A Unified Conversational Recommender System Based on Item-guided Conditional Generation

Improving conversational recommender systems via multi-preference modeling and knowledge-enhanced

Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations

Enhancing User Personalization in Conversational Recommenders

Fusion learning of preference and bias from ratings and reviews for item recommendation

Finding Users Preferences from Large-Scale Online Reviews for Personalized Recommendation

FG-RS: Capture user fine-grained preferences through attribute information for Recommender Systems

Federated User Preference Modeling for Privacy-Preserving Cross-Domain Recommendation

Attentive Autoencoders for Multifaceted Preference Learning in One-class Collaborative Filtering

Towards Empathetic Conversational Recommender Systems

Stop Playing the Guessing Game! Target-free User Simulation for Evaluating Conversational Recommender Systems

Multi-Facet Recommender Networks with Spherical Optimization