RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendation

Sichun Luo,Bowei He,Haohan Zhao,Wei Shao,Yanlin Qi,Yinya Huang,Aojun Zhou,Yuxuan Yao,Zongpeng Li,Yuanzhang Xiao,Mingjie Zhan,Linqi Song
2024-03-31
Abstract:Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the in-context learning capabilities of LLMs for recommendation purposes. More recent studies have utilized instruction tuning techniques to align LLMs with human preferences, promising more effective recommendations. However, existing methods suffer from several limitations. The full potential of LLMs is not fully elicited due to low-quality tuning data and the overlooked integration of conventional recommender signals. Furthermore, LLMs may generate inconsistent responses for different ranking tasks in the recommendation, potentially leading to unreliable results.
Computer Science
What problem does this paper attempt to address?
The paper focuses on how to better utilize Large Language Models (LLMs) for the Top-k recommendation problem in recommendation systems. Existing methods have several limitations when using LLMs, including low-quality fine-tuning data, neglecting the integration of traditional recommendation signals, and the issue of inconsistent responses of LLMs in different ranking tasks. To address these limitations, the paper proposes RecRanker, a directive fine-tuning method for LLMs in Top-k recommendation. RecRanker obtains high-quality, representative, and diversified training data through importance-aware sampling, clustering-based sampling, and re-sampling penalty strategies. In addition, the paper introduces a position movement strategy to alleviate position bias and enriches the understanding of LLMs by combining auxiliary information from traditional recommendation models. The augmentation prompts constructed using these strategies include pointwise, pairwise, and listwise ranking tasks. The paper also proposes a hybrid ranking method that improves model performance by combining these tasks. Experimental results demonstrate the effectiveness of RecRanker in both direct recommendation and sequential recommendation scenarios, proving its advantages in Top-k recommendation.