Abstract:Conversational Recommender Systems (CoRSs) implement a paradigm that allows users to interact in natural language with the system for defining their preferences and discovering items that best fit their needs. CoRSs can be straightforwardly implemented as chatbots that, nowadays, are becoming more and more popular for several applications, such as customer care, health care, and medical diagnoses. Chatbots implement an interaction based on natural language, buttons, or both. The implementation of a chatbot is a challenging task since it requires knowledge about natural language processing and human–computer interaction. A CoRS might be particularly useful in the music domain since music is generally enjoyed in contexts when a standard interface cannot be exploited (driving, doing homeworks, running). However, there is no work in the literature that analytically compares different interaction modes for a conversational music recommender system. In this paper, we focus on the design and implementation of a CoRS for the music domain. Our CoRS consists of different components. The system implements content-based recommendation, critiquing and adaptive strategies, as well as explanation facilities. The main innovative contribution is that the user can interact through different interaction modes: natural language, buttons, and mixed. Due to the lack of available datasets for testing CoRSs, we carried out an in vivo experimental evaluation with the goal of investigating the impact of the different interaction modes on the recommendation accuracy and on the cost of interaction for the final user. The experiment involved 110 people, and 54 completed the whole process. The analysis of the results shows that the best interaction mode is based on a mixed strategy that combines buttons and natural language. In addition, the results allow to clearly understand which are the steps in the dialog that are particularly strenuous for the user.

Evaluating Conversational Recommender Systems: A Landscape of Research

A Survey on Conversational Recommender Systems

Advances and Challenges in Conversational Recommender Systems: A Survey

Conversational Recommendation: Formulation, Methods, and Evaluation

Concept -- An Evaluation Protocol on Conversational Recommender Systems with System-centric and User-centric Factors

A Conversation is Worth A Thousand Recommendations: A Survey of Holistic Conversational Recommender Systems

How good your recommender system is? A survey on evaluations in recommendation

Towards Fair Conversational Recommender Systems

Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation

Towards Building Voice-based Conversational Recommender Systems: Datasets, Potential Solutions, and Prospects

Multi-Objective Recommender Systems: Survey and Challenges

Escaping the McNamara Fallacy: Towards more Impactful Recommender Systems Research

Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models

Intent Recognition in Conversational Recommender Systems

Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems

A Multi-Agent Conversational Recommender System

Understanding and Predicting User Satisfaction with Conversational Recommender Systems

Evaluation of session-based recommendation algorithms

Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents

Developing a Conversational Recommendation System for Navigating Limited Options

An investigation on the user interaction modes of conversational recommender systems for the music domain