Abstract:Recent progress in large language models (LLMs) offers promising new approaches for recommendation system (RecSys) tasks. While the current state-of-the-art methods rely on fine-tuning LLMs to achieve optimal results, this process is costly and introduces significant engineering complexities. Conversely, methods that bypass fine-tuning and use LLMs directly are less resource-intensive but often fail to fully capture both semantic and collaborative information, resulting in sub-optimal performance compared to their fine-tuned counterparts. In this paper, we propose a Simple Training-free Approach for Recommendation (STAR), a framework that utilizes LLMs and can be applied to various recommendation tasks without the need for fine-tuning. Our approach involves a retrieval stage that uses semantic embeddings from LLMs combined with collaborative user information to retrieve candidate items. We then apply an LLM for pairwise ranking to enhance next-item prediction. Experimental results on the Amazon Review dataset show competitive performance for next item prediction, even with our retrieval stage alone. Our full method achieves Hits@10 performance of +23.8% on Beauty, +37.5% on Toys and Games, and -1.8% on Sports and Outdoors relative to the best supervised models. This framework offers an effective alternative to traditional supervised models, highlighting the potential of LLMs in recommendation systems without extensive training or custom architectures.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is: how to use large - language models (LLMs) to provide effective solutions for recommendation system (RecSys) tasks without fine - tuning. Currently, the state - of - the - art methods rely on fine - tuning LLMs to achieve the best results, but this process is costly and introduces significant engineering complexity. Conversely, methods that directly use LLMs without bypassing fine - tuning are less resource - consuming, but usually cannot fully capture semantic and collaborative information, resulting in performance inferior to that of the fine - tuned model. To solve these problems, the author proposes a simple, training - free recommendation method (STAR). This framework utilizes LLMs and can be applied in various recommendation tasks without fine - tuning. Specifically, the STAR framework includes two stages: 1. **Retrieval stage**: - Use semantic embeddings to retrieve candidate items from LLMs combined with user collaboration information. - Score by calculating the semantic similarity and collaborative relationship between new items and items with which the user has historically interacted. The scoring formula is as follows: \[ \text{score}(x)=\frac{1}{n}\sum_{j = 1}^{n}r_j\cdot\lambda^{t_j}\cdot\left(a\cdot R_{xj}^S+(1 - a)\cdot R_{xj}^C\right) \] where: - \(R_{xj}^S\) and \(R_{xj}^C\) represent the semantic and collaborative relationships between the unseen item \(x\) and the item \(s_j\) in the user's history, respectively. - \(r_j\) is the user's rating of item \(s_j\). - \(\lambda^{t_j}\) is an exponential decay function used to weight the most recent interactions according to the time sequence. - \(a\) is a weighting factor for semantic and collaborative information. 2. **Ranking stage**: - Use the reasoning ability of LLMs to perform pair - wise ranking on the initially retrieved candidate items to enhance the prediction performance of the next item. - The ranking strategies include three methods: point - wise, pair - wise, and list - wise. The experimental results show that the STAR framework is competitive in performance on the Amazon Review dataset, especially achieving significant improvements in the Beauty and Toys and Games categories, while performing slightly worse in the Sports and Outdoors category. These results demonstrate that STAR is an effective alternative to traditional supervised models, highlighting the potential of LLMs in recommendation systems without the need for extensive training or custom architectures. In summary, this paper aims to explore an efficient, low - cost, and fine - tuning - free LLMs - based recommendation system method, thereby promoting the further development of recommendation systems.

STAR: A Simple Training-free Approach for Recommendations using Large Language Models

Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

Personalized Recommendation Systems Powered By Large Language Models: Integrating Semantic Understanding and User Preferences

Large Language Models Make Sample-Efficient Recommender Systems

Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System

Representation Learning with Large Language Models for Recommendation

Recommender Systems in the Era of Large Language Models (LLMs)

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling

LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking

LLMRec: Large Language Models with Graph Augmentation for Recommendation

Aligning Large Language Models with Recommendation Knowledge

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Harnessing Large Language Models for Text-Rich Sequential Recommendation

Leveraging Large Language Models for Pre-trained Recommender Systems

Improving Sequential Recommendations with LLMs

TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation

Unleash LLMs Potential for Recommendation by Coordinating Twin-Tower Dynamic Semantic Token Generator

LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

A Survey on Large Language Models for Recommendation