Abstract:A Conversational Recommender System (CRS) offers increased transparency and control to users by enabling them to engage with the system through a real-time multi-turn dialogue. Recently, Large Language Models (LLMs) have exhibited an unprecedented ability to converse naturally and incorporate world knowledge and common-sense reasoning into language understanding, unlocking the potential of this paradigm. However, effectively leveraging LLMs within a CRS introduces new technical challenges, including properly understanding and controlling a complex conversation and retrieving from external sources of information. These issues are exacerbated by a large, evolving item corpus and a lack of conversational data for training. In this paper, we provide a roadmap for building an end-to-end large-scale CRS using LLMs. In particular, we propose new implementations for user preference understanding, flexible dialogue management and explainable recommendations as part of an integrated architecture powered by LLMs. For improved personalization, we describe how an LLM can consume interpretable natural language user profiles and use them to modulate session-level context. To overcome conversational data limitations in the absence of an existing production CRS, we propose techniques for building a controllable LLM-based user simulator to generate synthetic conversations. As a proof of concept we introduce RecLLM, a large-scale CRS for YouTube videos built on LaMDA, and demonstrate its fluency and diverse functionality through some illustrative example conversations.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively utilize large language models (LLMs) in the Conversational Recommender System (CRS). Although LLMs have demonstrated unprecedented capabilities in natural conversations, world knowledge, and common - sense reasoning, there are still technical challenges in effectively integrating them into CRS, including but not limited to: 1. **Understanding and Controlling Complex Conversations**: How to make LLM correctly understand the context in multi - round conversations and make appropriate responses accordingly. 2. **Retrieval of External Information Sources**: How to enable LLM to retrieve information from external databases or recommendation engines, especially when dealing with large - scale and constantly changing product libraries. 3. **Lack of Conversation Data**: Due to the lack of conversation data in practical applications, how to train and optimize LLM - based CRS. To solve these problems, the paper proposes an end - to - end roadmap for building large - scale CRS. Specific contributions include: - **Conversation Management Module**: Unify tasks such as natural language generation, preference understanding, context tracking, and recommendation requests into a single language modeling task of LLM. - **Retrieval Framework**: Propose a general conceptual framework for efficient retrieval in large - scale product libraries. Specific methods include the generalized dual - encoder model, direct LLM search, concept - based search, and search API lookup. - **Ranking and Explanation Module**: Use LLM to score candidate items according to the conversation context and generate natural language explanations to improve the transparency of the system. - **Integration of Natural Language User Profiles**: By parsing the user's natural language profile, enhance the understanding of the session - level context and improve the personalized experience. - **Controllable LLM User Simulator**: Develop techniques to generate synthetic conversations for the tuning and evaluation of system components. The paper also introduces RecLLM, a YouTube video recommendation system based on LaMDA, demonstrating its fluency and diverse functions. Through these techniques and methods, the paper aims to prove the potential and feasibility of LLM - based conversation recommendation systems.

Leveraging Large Language Models in Conversational Recommender Systems

A Large Language Model Enhanced Conversational Recommender System

A Multi-Agent Conversational Recommender System

Large Language Model Driven Recommendation

A LLM-based Controllable, Scalable, Human-Involved User Simulator Framework for Conversational Recommender Systems

Collaborative Large Language Model for Recommender Systems

EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME context

Large Language Models Enhanced Collaborative Filtering

Leveraging Large Language Models for Pre-trained Recommender Systems

Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models

Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue

Incorporating External Knowledge and Goal Guidance for LLM-based Conversational Recommender Systems

How Can Recommender Systems Benefit from Large Language Models: A Survey

CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendation

Large Language Models as Conversational Movie Recommenders: A User Study

Recommender Systems in the Era of Large Language Models (LLMs)

LLaRA: Aligning Large Language Models with Sequential Recommenders.

OMuleT: Orchestrating Multiple Tools for Practicable Conversational Recommendation