Abstract:With large language models (LLMs) achieving remarkable breakthroughs in natural language processing (NLP) domains, LLM-enhanced recommender systems have received much attention and have been actively explored currently. In this paper, we focus on adapting and empowering a pure large language model for zero-shot and few-shot recommendation tasks. First and foremost, we identify and formulate the lifelong sequential behavior incomprehension problem for LLMs in recommendation domains, i.e., LLMs fail to extract useful information from a textual context of long user behavior sequence, even if the length of context is far from reaching the context limitation of LLMs. To address such an issue and improve the recommendation performance of LLMs, we propose a novel framework, namely Retrieval-enhanced Large Language models (ReLLa) for recommendation tasks in both zero-shot and few-shot settings. For zero-shot recommendation, we perform semantic user behavior retrieval (SUBR) to improve the data quality of testing samples, which greatly reduces the difficulty for LLMs to extract the essential knowledge from user behavior sequences. As for few-shot recommendation, we further design retrieval-enhanced instruction tuning (ReiT) by adopting SUBR as a data augmentation technique for training samples. Specifically, we develop a mixed training dataset consisting of both the original data samples and their retrieval-enhanced counterparts. We conduct extensive experiments on three real-world public datasets to demonstrate the superiority of ReLLa compared with existing baseline models, as well as its capability for lifelong sequential behavior comprehension. To be highlighted, with only less than 10% training samples, few-shot ReLLa can outperform traditional CTR models that are trained on the entire training set (e.g., DCNv2, DIN, SIM). The code is available \url{<a class="link-external link-https" href="https://github.com/LaVieEnRose365/ReLLa" rel="external noopener nofollow">this https URL</a>}.

ReLoop

ReLoop: A Self-Correction Continual Learning Loop for Recommender Systems

ReLoop2: Building Self-Adaptive Recommendation Models Via Responsive Error Compensation Loop.

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendation

Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems

Deep Reinforcement Learning for List-wise Recommendations

RLRF4Rec: Reinforcement Learning from Recsys Feedback for Enhanced Recommendation Reranking

Inverse Learning with Extremely Sparse Feedback for Recommendation

Breaking Feedback Loops in Recommender Systems with Causal Inference

A Deep Reinforcement Learning Based Long-Term Recommender System

Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendation

Do Not Wait: Learning Re-Ranking Model Without User Feedback At Serving Time in E-Commerce

LLM-enhanced Reranking in Recommender Systems

RecoGym: A Reinforcement Learning Environment for the problem of Product Recommendation in Online Advertising

ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation

Incremental Learning for Personalized Recommender Systems

Deep Learning Based Recommender System

Enhancing Sequential Recommendations through Multi-Perspective Reflections and Iteration

DRN: A Deep Reinforcement Learning Framework for News Recommendation.

Optimizing Ranking Algorithm in Recommender System Via Deep Reinforcement Learning