Examining the Potential for Conversational Exploratory Search using a Smart Speaker Digital Assistant

Abhishek Kaushik,Gareth J.F. Jones

DOI: https://doi.org/10.5220/0011798700003417

2023-03-19

Abstract:Online Digital Assistants, such as Amazon Alexa, Google Assistant, Apple Siri are very popular and provide a range or services to their users, a key function is their ability to satisfy user information needs from the sources available to them. Users may often regard these applications as providing search services similar to Google type search engines. However, while it is clear that they are in general able to answer factoid questions effectively, it is much less obvious how well they support less specific or exploratory type search tasks. We describe an investigation examining the behaviour of the standard Amazon Alexa for exploratory search tasks. The results of our study show that it not effective in addressing these types of information needs. We propose extensions to Alexa designed to overcome these shortcomings. Our Custom Alexa application extends Alexa's conversational functionality for exploratory search. A user study shows that our extended Alexa application both enables users to more successfully complete exploratory search tasks and is well accepted by our test users.

Human-Computer Interaction,Information Retrieval

What problem does this paper attempt to address?

The paper attempts to address the issue of the current smart speaker digital assistants (such as Amazon Alexa) having limited capabilities in supporting exploratory information needs. Although these digital assistants can effectively answer factual questions, they perform poorly when handling less specific or exploratory search tasks. Researchers examined the behavior of standard Amazon Alexa in performing exploratory search tasks through experiments and found significant deficiencies in supporting such tasks, leading to user frustration and dissatisfaction.

To overcome these issues, the researchers proposed extending Alexa by designing a new conversational strategy to enhance its functionality in exploratory search tasks. Specifically, they developed a custom Alexa application that extended Alexa's conversational capabilities, enabling users to complete exploratory search tasks more successfully, and it was well received by test users.

The main research questions include:
1. What are the challenges and opportunities of using Alexa for exploratory conversational search?
2. What features limit Alexa as an effective tool for complex information retrieval?
3. What are the main user expectations for conversational search systems?

The research results indicate that standard Alexa has multiple issues in handling exploratory search tasks, including low task success rate, high user frustration, poor knowledge representation, high speech recognition error rate, and difficulty in asking questions. Based on these findings, the researchers proposed improvements, including providing background knowledge support, adopting a conversation-driven approach, and improving information representation.