Abstract:Sequential recommendation is to predict the next item of interest for a user, based on her/his interaction history with previous items. In conventional sequential recommenders, a common approach is to model item sequences using discrete IDs, learning representations that encode sequential behaviors and reflect user preferences. Inspired by recent success in empowering large language models (LLMs) to understand and reason over diverse modality data (e.g., image, audio, 3D points), a compelling research question arises: ``Can LLMs understand and work with hidden representations from ID-based sequential recommenders?''.To answer this, we propose a simple framework, RecInterpreter, which examines the capacity of open-source LLMs to decipher the representation space of sequential recommenders. Specifically, with the multimodal pairs (\ie representations of interaction sequence and text narrations), RecInterpreter first uses a lightweight adapter to map the representations into the token embedding space of the LLM. Subsequently, it constructs a sequence-recovery prompt that encourages the LLM to generate textual descriptions for items within the interaction sequence. Taking a step further, we propose a sequence-residual prompt instead, which guides the LLM in identifying the residual item by contrasting the representations before and after integrating this residual into the existing sequence. Empirical results showcase that our RecInterpreter enhances the exemplar LLM, LLaMA, to understand hidden representations from ID-based sequential recommenders, especially when guided by our sequence-residual prompts. Furthermore, RecInterpreter enables LLaMA to instantiate the oracle items generated by generative recommenders like DreamRec, concreting the item a user would ideally like to interact with next. Codes are available at <a class="link-external link-https" href="https://github.com/YangZhengyi98/RecInterpreter" rel="external noopener nofollow">this https URL</a>.

Enhancing High-order Interaction Awareness in LLM-based Recommender Model

Representation Learning with Large Language Models for Recommendation

Enhancing Recommender Systems with Large Language Model Reasoning Graphs

LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

Large Language Model Can Interpret Latent Space of Sequential Recommender

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendations

Large Language Models Enhanced Collaborative Filtering

LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation

LLMRec: Large Language Models with Graph Augmentation for Recommendation

Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling

Large Language Model with Graph Convolution for Recommendation

Towards a Unified Paradigm: Integrating Recommendation Systems as a New Language in Large Models

Incorporate LLMs with Influential Recommender System

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

Large Language Models for Recommendation: Progresses and Future Directions

CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendation

Item-Language Model for Conversational Recommendation

Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language Models

Recommender Systems in the Era of Large Language Models (LLMs)