Abstract:Users often formulate their search queries and questions with immature language without well-developed keywords and complete structures. Such queries are likely to fail to express their true information needs and raise ambiguity as fragmental language often yield various interpretations and aspects. This gives search engines a hard time processing and understanding the query, and eventually leads to unsatisfactory retrieval results. An alternative approach to direct answer while facing an ambiguous query is to proactively ask clarifying questions to the user. Recent years have seen many works and shared tasks from both NLP and IR community about identifying the need for asking clarifying question and methodology to generate them. An often neglected fact by these works is that although sometimes the need for clarifying questions is correctly recognized, the clarifying questions these system generate are still off-topic and dissatisfaction provoking to users and may just cause users to leave the conversation. In this work, we propose a risk-aware conversational search agent model to balance the risk of answering user's query and asking clarifying questions. The agent is fully aware that asking clarifying questions can potentially collect more information from user, but it will compare all the choices it has and evaluate the risks. Only after then, it will make decision between answering or asking. To demonstrate that our system is able to retrieve better answers, we conduct experiments on the MSDialog dataset which contains real-world customer service conversations from Microsoft products community. We also purpose a reinforcement learning strategy which allows us to train our model on the original dataset directly and saves us from any further data annotation efforts. Our experiment results show that our risk-aware conversational search agent is able to significantly outperform strong non-risk-aware baselines.

Resolving Intent Ambiguities by Retrieving Discriminative Clarifying Questions

Generating Intent-aware Clarifying Questions in Conversational Information Retrieval Systems

Data Distillation for Controlling Specificity in Dialogue Generation.

Learning through Dialogue Interactions by Asking Questions

Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions

Generating Clarifying Questions for Information Retrieval

Enabling Morally Sensitive Robotic Clarification Requests

Semantically-Driven Disambiguation for Human-Robot Interaction

An Empirical Study on Clarifying Question-Based Systems.

Self-supervised Clarification Question Generation for Ambiguous Multi-Turn Conversation.

Controlling the Risk of Conversational Search Via Reinforcement Learning

Conformal Intent Classification and Clarification for Fast and Accurate Intent Recognition

An Empirical Study of Clarifying Question-Based Systems

Asking Clarification Questions in Knowledge-Based Question Answering.

Conversational Search with Mixed-Initiative - Asking Good Clarification Questions backed-up by Passage Retrieval

Machines Getting with the Program: Understanding Intent Arguments of Non-Canonical Directives

Clarifying the Path to User Satisfaction: An Investigation into Clarification Usefulness

Using clarification questions to improve software developers' Web search

QUESTION ANSWERING AS DIALOGUE WITH DATA

Understanding Developers' Natural Language Queries with Interactive Clarification.

How to Approach Ambiguous Queries in Conversational Search: A Survey of Techniques, Approaches, Tools, and Challenges