Abstract:Sequential recommendation is to predict the next item of interest for a user, based on her/his interaction history with previous items. In conventional sequential recommenders, a common approach is to model item sequences using discrete IDs, learning representations that encode sequential behaviors and reflect user preferences. Inspired by recent success in empowering large language models (LLMs) to understand and reason over diverse modality data (e.g., image, audio, 3D points), a compelling research question arises: ``Can LLMs understand and work with hidden representations from ID-based sequential recommenders?''.To answer this, we propose a simple framework, RecInterpreter, which examines the capacity of open-source LLMs to decipher the representation space of sequential recommenders. Specifically, with the multimodal pairs (\ie representations of interaction sequence and text narrations), RecInterpreter first uses a lightweight adapter to map the representations into the token embedding space of the LLM. Subsequently, it constructs a sequence-recovery prompt that encourages the LLM to generate textual descriptions for items within the interaction sequence. Taking a step further, we propose a sequence-residual prompt instead, which guides the LLM in identifying the residual item by contrasting the representations before and after integrating this residual into the existing sequence. Empirical results showcase that our RecInterpreter enhances the exemplar LLM, LLaMA, to understand hidden representations from ID-based sequential recommenders, especially when guided by our sequence-residual prompts. Furthermore, RecInterpreter enables LLaMA to instantiate the oracle items generated by generative recommenders like DreamRec, concreting the item a user would ideally like to interact with next. Codes are available at <a class="link-external link-https" href="https://github.com/YangZhengyi98/RecInterpreter" rel="external noopener nofollow">this https URL</a>.

Memory Network-Based Interpreter of User Preferences in Content-Aware Recommender Systems

Sequential Modeling of Hierarchical User Intention and Preference for Next-item Recommendation

Sequential Recommendation with User Memory Networks

Hierarchical User Intention-Preference for Sequential Recommendation with Relation-Aware Heterogeneous Information Network Embedding

Towards Interpretation of Recommender Systems with Sorted Explanation Paths

Paper Recommendation with Item-Level Collaborative Memory Network.

Neuro-Symbolic Interpretable Collaborative Filtering for Attribute-based Recommendation

Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation.

Gated Sequential Recommendation with Dynamic Memory Network

SPR-SMN: scientific paper recommendation employing SPECTER with memory network

Recurrent Memory Networks:Modeling Long Short-Term User Pref-Erences for Session-Based Recommendation

Memory-Augmented Attention Network for Sequential Recommendation

Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors

A recommender system fused with implicit social information through network representation learning

Item-Based Collaborative Memory Networks for Recommendation

Denoising User-aware Memory Network for Recommendation

Explain by Evidence: An Explainable Memory-based Neural Network for Question Answering

Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systems

Personalized Fashion Recommendation with Visual Explanations Based on Multimodal Attention Network

Large Language Model Can Interpret Latent Space of Sequential Recommender

An Approach to Semantic-Aware Heterogeneous Network Embedding for Recommender Systems