Abstract:Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on ID-based data, potentially disregarding valuable textual information associated with users and items, resulting in less informative learned representations. Moreover, the utilization of implicit feedback data introduces potential noise and bias, posing challenges for the effectiveness of user preference learning. While the integration of large language models (LLMs) into traditional ID-based recommenders has gained attention, challenges such as scalability issues, limitations in text-only reliance, and prompt input constraints need to be addressed for effective implementation in practical recommender systems. To address these challenges, we propose a model-agnostic framework RLMRec that aims to enhance existing recommenders with LLM-empowered representation learning. It proposes a recommendation paradigm that integrates representation learning with LLMs to capture intricate semantic aspects of user behaviors and preferences. RLMRec incorporates auxiliary textual signals, develops a user/item profiling paradigm empowered by LLMs, and aligns the semantic space of LLMs with the representation space of collaborative relational signals through a cross-view alignment framework. This work further establish a theoretical foundation demonstrating that incorporating textual signals through mutual information maximization enhances the quality of representations. In our evaluation, we integrate RLMRec with state-of-the-art recommender models, while also analyzing its efficiency and robustness to noise data. Our implementation codes are available at <a class="link-external link-https" href="https://github.com/HKUDS/RLMRec" rel="external noopener nofollow">this https URL</a>.

Representation Learning in Low-rank Slate-based Recommender Systems

Representation Learning for Online and Offline RL in Low-rank MDPs

Locality-Sensitive State-Guided Experience Replay Optimization for Sparse Rewards in Online Recommendation

State representation modeling for deep reinforcement learning based recommendation

Provably Efficient Representation Selection in Low-rank Markov Decision Processes: From Online to Offline RL

On Causally Disentangled State Representation Learning for Reinforcement Learning based Recommender Systems

Deep Reinforcement Learning for List-wise Recommendations

Slate-Aware Ranking for Recommendation

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Probabilistic Rank and Reward: A Scalable Model for Slate Recommendation

Improved Sample Complexity for Reward-free Reinforcement Learning under Low-rank MDPs

Representation Learning with Large Language Models for Recommendation

A stable deep reinforcement learning framework for recommendation

Intrinsically Motivated Reinforcement Learning Based Recommendation with Counterfactual Data Augmentation

ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systems

Distributional Off-Policy Evaluation for Slate Recommendations

Generative Adversarial User Model for Reinforcement Learning Based Recommendation System

Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendation

Reinforcement Learning-based Recommender Systems with Large Language Models for State Reward and Action Modeling

Exploration and Regularization of the Latent Action Space in Recommendation

Sim-to-Real Interactive Recommendation via Off-Dynamics Reinforcement Learning