Abstract:Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most users interact with only a handful of items, while the majority of items are seldom consumed. These two issues, known as the long-tail user and long-tail item challenges, often pose difficulties for existing SRS. These challenges can adversely affect user experience and seller benefits, making them crucial to address. Though a few works have addressed the challenges, they still struggle with the seesaw or noisy issues due to the intrinsic scarcity of interactions. The advancements in large language models (LLMs) present a promising solution to these problems from a semantic perspective. As one of the pioneers in this field, we propose the Large Language Models Enhancement framework for Sequential Recommendation (LLM-ESR). This framework utilizes semantic embeddings derived from LLMs to enhance SRS without adding extra inference load from LLMs. To address the long-tail item challenge, we design a dual-view modeling framework that combines semantics from LLMs and collaborative signals from conventional SRS. For the long-tail user challenge, we propose a retrieval augmented self-distillation method to enhance user preference representation using more informative interactions from similar users. To verify the effectiveness and versatility of our proposed enhancement framework, we conduct extensive experiments on three real-world datasets using three popular SRS models. The results show that our method surpasses existing baselines consistently, and benefits long-tail users and items especially. The implementation code is available at <a class="link-external link-https" href="https://github.com/Applied-Machine-Learning-Lab/LLM-ESR" rel="external noopener nofollow">this https URL</a>.

Towards More Relevant Product Search Ranking Via Large Language Models: An Empirical Study

Large Language Models for Relevance Judgment in Product Search

Leveraging Large Language Models to Enhance Personalized Recommendations in E-commerce

Manipulating Large Language Models to Increase Product Visibility

Explainable LLM-driven Multi-dimensional Distillation for E-Commerce Relevance Learning

Investigating LLM Applications in E-Commerce

Emerging Synergies Between Large Language Models and Machine Learning in Ecommerce Recommendations

Self-Calibrated Listwise Reranking with Large Language Models

Make Large Language Model a Better Ranker

Large Search Model: Redefining Search Stack in the Era of LLMs

Pretrained Language Model based Web Search Ranking: From Relevance to Satisfaction

Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

Boosting LLM-based Relevance Modeling with Distribution-Aware Robust Learning

Improving Pinterest Search Relevance Using Large Language Models

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

Leveraging Large Language Models for Enhanced Product Descriptions in eCommerce

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Know where to go: Make LLM a relevant, responsible, and trustworthy searchers

Learning a Product Relevance Model from Click-Through Data in E-Commerce

Best Practices for Distilling Large Language Models into BERT for Web Search Ranking

When Search Engine Services meet Large Language Models: Visions and Challenges