GenRec: Large Language Model for Generative Recommendation

Jianchao Ji,Zelong Li,Shuyuan Xu,Wenyue Hua,Yingqiang Ge,Juntao Tan,Yongfeng Zhang

2023-07-05

Abstract:In recent years, large language models (LLM) have emerged as powerful tools for diverse natural language processing tasks. However, their potential for recommender systems under the generative recommendation paradigm remains relatively unexplored. This paper presents an innovative approach to recommendation systems using large language models (LLMs) based on text data. In this paper, we present a novel LLM for generative recommendation (GenRec) that utilized the expressive power of LLM to directly generate the target item to recommend, rather than calculating ranking score for each candidate item one by one as in traditional discriminative recommendation. GenRec uses LLM's understanding ability to interpret context, learn user preferences, and generate relevant recommendation. Our proposed approach leverages the vast knowledge encoded in large language models to accomplish recommendation tasks. We first we formulate specialized prompts to enhance the ability of LLM to comprehend recommendation tasks. Subsequently, we use these prompts to fine-tune the LLaMA backbone LLM on a dataset of user-item interactions, represented by textual data, to capture user preferences and item characteristics. Our research underscores the potential of LLM-based generative recommendation in revolutionizing the domain of recommendation systems and offers a foundational framework for future explorations in this field. We conduct extensive experiments on benchmark datasets, and the experiments shows that our GenRec has significant better results on large dataset.

Information Retrieval,Artificial Intelligence,Computation and Language,Machine Learning

What problem does this paper attempt to address?

This paper aims to explore the application of large language models (LLM) in generative recommendation systems. Traditionally, recommendation systems mainly rely on techniques such as collaborative filtering, content-based filtering, and hybrid methods. However, these methods have some limitations, such as the cold start problem, data sparsity issue, and scalability challenges as the number of users and items grows. To address these issues, the paper proposes a new large language model—GenRec, for generative recommendation.

Specifically, GenRec leverages the powerful text understanding and generation capabilities of LLM to directly generate target recommendations, rather than calculating and ranking the scores of each candidate item one by one as in traditional discriminative recommendations. This approach can better understand context, learn user preferences, and generate relevant recommendations. Additionally, GenRec enhances the performance of generative recommendations by incorporating textual information into the model, especially excelling in handling complex user interaction data.

Experimental results show that GenRec significantly outperforms existing LLM recommendation models on the MovieLens 25M dataset, while its performance on the Amazon Toys dataset is slightly inferior. This may be because the MovieLens 25M dataset contains richer interaction information, allowing the model to more accurately understand user preferences and behaviors, thereby generating more precise recommendations. In summary, GenRec demonstrates potential in the field of generative recommendation and provides a foundational framework for future research.