Abstract:Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most users interact with only a handful of items, while the majority of items are seldom consumed. These two issues, known as the long-tail user and long-tail item challenges, often pose difficulties for existing SRS. These challenges can adversely affect user experience and seller benefits, making them crucial to address. Though a few works have addressed the challenges, they still struggle with the seesaw or noisy issues due to the intrinsic scarcity of interactions. The advancements in large language models (LLMs) present a promising solution to these problems from a semantic perspective. As one of the pioneers in this field, we propose the Large Language Models Enhancement framework for Sequential Recommendation (LLM-ESR). This framework utilizes semantic embeddings derived from LLMs to enhance SRS without adding extra inference load from LLMs. To address the long-tail item challenge, we design a dual-view modeling framework that combines semantics from LLMs and collaborative signals from conventional SRS. For the long-tail user challenge, we propose a retrieval augmented self-distillation method to enhance user preference representation using more informative interactions from similar users. To verify the effectiveness and versatility of our proposed enhancement framework, we conduct extensive experiments on three real-world datasets using three popular SRS models. The results show that our method surpasses existing baselines consistently, and benefits long-tail users and items especially. The implementation code is available at <a class="link-external link-https" href="https://github.com/Applied-Machine-Learning-Lab/LLM-ESR" rel="external noopener nofollow">this https URL</a>.

Improving Collaborative Filtering with Long-Short Interest Model

Using latent class models for neighbors selection in collaborative filtering

Hybrid Gaussian pLSA model and item based collaborative filtering recommendation

Improving Recommendations With Collaborative Factors

A unified latent factor correction scheme for collaborative filtering

Information Filtering Via Collaborative User Clustering Modeling.

Long Short-Term Memory Based Recurrent Neural Networks for Collaborative Filtering

Deep Collaborative Filtering Incorporating Auxiliary Multi-Media Information.

Collaborative Filtering with Topic and Social Latent Factors Incorporating Implicit Feedback

CDF-LS: Contrastive Network for Emphasizing Feature Differences with Fusing Long- and Short-Term Interest Features

An improved collaborative filtering method based on similarity

Large Language Models Enhanced Collaborative Filtering

Exploiting Latent Relations Between Users and Items for Collaborative Filtering.

Deep Item-based Collaborative Filtering for Top-N Recommendation

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Collaborative Filtering with User-Item Co-Autoregressive Models

Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation.

Social Collaborative Mutual Learning for Item Recommendation

Deep Item-based Collaborative Filtering for Sparse Implicit Feedback

Cross-Grained Neural Collaborative Filtering for Recommendation

A Dynamic Collaborative Filtering Algorithm based on Convolutional Neural Networks and Multi-layer Perceptron