Abstract:Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most users interact with only a handful of items, while the majority of items are seldom consumed. These two issues, known as the long-tail user and long-tail item challenges, often pose difficulties for existing SRS. These challenges can adversely affect user experience and seller benefits, making them crucial to address. Though a few works have addressed the challenges, they still struggle with the seesaw or noisy issues due to the intrinsic scarcity of interactions. The advancements in large language models (LLMs) present a promising solution to these problems from a semantic perspective. As one of the pioneers in this field, we propose the Large Language Models Enhancement framework for Sequential Recommendation (LLM-ESR). This framework utilizes semantic embeddings derived from LLMs to enhance SRS without adding extra inference load from LLMs. To address the long-tail item challenge, we design a dual-view modeling framework that combines semantics from LLMs and collaborative signals from conventional SRS. For the long-tail user challenge, we propose a retrieval augmented self-distillation method to enhance user preference representation using more informative interactions from similar users. To verify the effectiveness and versatility of our proposed enhancement framework, we conduct extensive experiments on three real-world datasets using three popular SRS models. The results show that our method surpasses existing baselines consistently, and benefits long-tail users and items especially. The implementation code is available at <a class="link-external link-https" href="https://github.com/Applied-Machine-Learning-Lab/LLM-ESR" rel="external noopener nofollow">this https URL</a>.

Enhancing Sequential Recommendation Via LLM-based Semantic Embedding Learning

LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Beyond Inter-Item Relations: Dynamic Adaption for Enhancing LLM-Based Sequential Recommendation

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

Break the ID-Language Barrier: An Adaption Framework for Sequential Recommendation

Long-short Interest Network with Graph-Based Method for Sequential Recommendation

Towards Scalable Semantic Representation for Recommendation

Harnessing Large Language Models for Text-Rich Sequential Recommendation

Empowering Sequential Recommendation from Collaborative Signals and Semantic Relatedness

Enhancing Sequential Recommenders with Augmented Knowledge from Aligned Large Language Models

SLMRec: Empowering Small Language Models for Sequential Recommendation

Lightweight Self-Attentive Sequential Recommendation

Towards Efficient and Effective Adaptation of Large Language Models for Sequential Recommendation

Deep Bi-LSTM Networks for Sequential Recommendation

Recognizing Semantics-Consistent Subsequences for Sequential Recommendation

Improving Sequential Recommendations with LLMs

Rethinking Large Language Model Architectures for Sequential Recommendations

MCL4SRec: A Sequential Recommendation Model with Multi-level Contrastive Learning

Temporal Item Embedding With Static Similarity Regularization For Sequential Recommendation