Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach

Junjie Zhang,Ruobing Xie,Yupeng Hou,Wayne Xin Zhao,Leyu Lin,Ji-Rong Wen

2023-05-12

Abstract:In the past decades, recommender systems have attracted much attention in both research and industry communities, and a large number of studies have been devoted to developing effective recommendation models. Basically speaking, these models mainly learn the underlying user preference from historical behavior data, and then estimate the user-item matching relationships for recommendations. Inspired by the recent progress on large language models (LLMs), we take a different approach to developing the recommendation models, considering recommendation as instruction following by LLMs. The key idea is that the preferences or needs of a user can be expressed in natural language descriptions (called instructions), so that LLMs can understand and further execute the instruction for fulfilling the recommendation task. Instead of using public APIs of LLMs, we instruction tune an open-source LLM (3B Flan-T5-XL), in order to better adapt LLMs to recommender systems. For this purpose, we first design a general instruction format for describing the preference, intention, task form and context of a user in natural language. Then we manually design 39 instruction templates and automatically generate a large amount of user-personalized instruction data (252K instructions) with varying types of preferences and intentions. To demonstrate the effectiveness of our approach, we instantiate the instruction templates into several widely-studied recommendation (or search) tasks, and conduct extensive experiments on these tasks with real-world datasets. Experiment results show that the proposed approach can outperform several competitive baselines, including the powerful GPT-3.5, on these evaluation tasks. Our approach sheds light on developing more user-friendly recommender systems, in which users can freely communicate with the system and obtain more accurate recommendations via natural language instructions.

Information Retrieval,Computation and Language

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to utilize the capabilities of large - language models (LLMs) in recommendation systems to better understand users' natural - language instructions, thereby providing more accurate and personalized recommendations. Traditional recommendation systems mainly rely on historical behavior data to learn user preferences and make recommendations accordingly. However, this method lacks the ability to flexibly express users' actual needs, especially the generalization ability when facing new users or new tasks. In addition, users' participation in traditional recommendation systems is often passive, and it is difficult for them to clearly express their real needs.

For this reason, the author proposes a new recommendation paradigm - regarding recommendation as the instruction - execution process of LLMs. By designing a specific instruction format, users are allowed to freely express specific needs in the form of natural language, and the recommendation system uses powerful LLMs to complete the recommendation task according to these instructions. This method can not only improve the personalization degree of the recommendation system, but also enhance the generalization ability of the system and user experience.

The main contributions of the paper include:
- Proposing a new method of formalizing recommendation tasks into natural - language instructions that LLMs can understand and execute.
- Designing a flexible and general - purpose instruction format that can cover different types of user needs and automatically generate a large amount of high - quality instruction data.
- Through instruction - tuning technology, a 3 - billion - parameter language model has been optimized specifically for the recommendation system, enabling it to better adapt to recommendation tasks and improve recommendation accuracy.

In this way, the paper explores how to use the powerful capabilities of LLMs to improve the performance of recommendation systems, especially in dealing with diverse user needs.