The Wizard of Curiosities: Enriching Dialogues with Fun Facts

Frederico Vicente,Rafael Ferreira,David Semedo,João Magalhães

2023-09-20

Abstract:Introducing curiosities in a conversation is a way to teach something new to the person in a pleasant and enjoyable way. Enriching dialogues with contextualized curiosities can improve the users' perception of a dialog system and their overall user experience. In this paper, we introduce a set of curated curiosities, targeting dialogues in the cooking and DIY domains. In particular, we use real human-agent conversations collected in the context of the Amazon Alexa TaskBot challenge, a multimodal and multi-turn conversational setting. According to an A/B test with over 1000 conversations, curiosities not only increase user engagement, but provide an average relative rating improvement of 9.7%.

Computation and Language

What problem does this paper attempt to address?

The paper primarily explores how to enhance user interaction with dialogue systems by introducing curiosities into conversations. Specifically, the researchers focused on the domains of recipes and do-it-yourself (DIY), carefully selecting a series of interesting and relevant facts, and designing a method to naturally integrate these facts into the dialogue flow that guides users through specific tasks.

The main contributions of the paper include:

1. **Constructing a carefully curated dataset of curiosities**: This dataset contains 1,351 curiosities related to the domains of cooking and DIY, aimed at enhancing the interaction experience between the dialogue system and users.
2. **Proposing a method to embed curiosities into dialogues**: The researchers developed two automated matching strategies, one based on text similarity and the other utilizing pre-trained language models for semantic similarity search, to determine which curiosities are most suitable for the current dialogue context.
3. **Designing a dialogue management strategy**: To ensure that curiosities are appropriately introduced into the conversation, the researchers designed a set of dialogue management strategies, including when to present and when to forgo introducing curiosities, to avoid interrupting users from completing tasks or causing cognitive overload.

Through large-scale A/B testing deployed on the Amazon Alexa platform, the results showed that the dialogue system using curiosities significantly improved user satisfaction compared to the version without them, with an average relative score increase of 9.7%. This indicates that reasonably introducing curiosities can effectively enhance user engagement and satisfaction with dialogue systems.