PALR: Personalization Aware LLMs for Recommendation

Fan Yang,Zheng Chen,Ziyan Jiang,Eunah Cho,Xiaojiang Huang,Yanbin Lu

2023-06-08

Abstract:Large language models (LLMs) have recently received significant attention for their exceptional capabilities. Despite extensive efforts in developing general-purpose LLMs that can be utilized in various natural language processing (NLP) tasks, there has been less research exploring their potential in recommender systems. In this paper, we propose a novel framework, named PALR, which aiming to combine user history behaviors (such as clicks, purchases, ratings, etc.) with LLMs to generate user preferred items. Specifically, we first use user/item interactions as guidance for candidate retrieval. Then we adopt a LLM-based ranking model to generate recommended items. Unlike existing approaches that typically adopt general-purpose LLMs for zero/few-shot recommendation testing or training on small-sized language models (with less than 1 billion parameters), which cannot fully elicit LLMs' reasoning abilities and leverage rich item side parametric knowledge, we fine-tune a 7 billion parameters LLM for the ranking purpose. This model takes retrieval candidates in natural language format as input, with instruction which explicitly asking to select results from input candidates during inference. Our experimental results demonstrate that our solution outperforms state-of-the-art models on various sequential recommendation tasks.

Information Retrieval,Artificial Intelligence,Computation and Language

What problem does this paper attempt to address?

The paper aims to address the issue of personalized recommendations in recommendation systems, specifically by attempting to improve the performance of recommendation systems using large-scale language models (LLMs). The paper proposes a new framework called PALR (Personalization Aware LLMs for Recommendation), which combines users' interaction history with large-scale language models to generate item recommendations that match user preferences. Compared to existing methods, PALR improves recommendation effectiveness in the following ways:

1. **User Behavior Integration**: Utilizes users' historical behaviors (such as clicks, purchases, ratings, etc.) as guidance to generate user preference keywords in natural language form.
2. **Candidate Item Retrieval**: Employs a retrieval module to pre-select some candidate items from the item pool, which are filtered based on the user's profile.
3. **Item Recommendation**: By combining users' historical behaviors, natural language user profiles, and the retrieved candidate items, a natural language prompt is created and input into the large-scale language model for further processing, thereby selecting items that best match user preferences.

Additionally, the paper details the specific implementation methods of the PALR framework, including how to design instruction tasks for model fine-tuning, and presents experimental results on two public datasets (MovieLens-1M and Amazon Beauty), demonstrating the superior performance of PALR in various recommendation tasks.