Abstract:For sequential recommender, the coarse-grained yet sparse sequential signals mined from massive user-item interactions have become the bottleneck to further improve the recommendation performance. To alleviate the spareness problem, exploiting auxiliary semantic features (\eg textual descriptions, visual images and knowledge graph) to enrich contextual information then turns into a mainstream methodology. Though effective, we argue that these different heterogeneous features certainly include much noise which may overwhelm the valuable sequential signals, and therefore easily reach the phenomenon of negative collaboration (ie 1 + 1 > 2). How to design a flexible strategy to select proper auxiliary information and alleviate the negative collaboration towards a better recommendation is still an interesting and open question. Unfortunately, few works have addressed this challenge in sequential recommendation. In this paper, we introduce a Multi-Agent RL-based Information S election Model (named MARIS) to explore an effective collaboration between different kinds of auxiliary information and sequential signals in an automatic way. Specifically, MARIS formalizes the auxiliary feature selection as a cooperative Multi-agent Markov Decision Process. For each auxiliary feature type, MARIS resorts to using an agent to determine whether a specific kind of auxiliary feature should be imported to achieve a positive collaboration. In between, a QMIX network is utilized to cooperate their joint selection actions and produce an episode corresponding an effective combination of different auxiliary features for the whole historical sequence. Considering the lack of supervised selection signals, we further devise a novel reward-guided sampling strategy to leverage exploitation and exploration scheme for episode sampling. By preserving them in a replay buffer, MARIS learns the action-value function and the reward alternatively for optimization. Extensive experiments on four real-world datasets demonstrate that our model obtains significant performance improvement over up-to-date state-of-the-art recommendation models.

Teach and Explore: A Multiplex Information-guided Effective and Efficient Reinforcement Learning for Sequential Recommendation

Robust Reinforcement Learning Objectives for Sequential Recommender Systems

Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendation

Multi-objective Meta-return Reinforcement Learning for Sequential Recommendation

KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation

CDARL: a contrastive discriminator-augmented reinforcement learning framework for sequential recommendations

End-to-End Deep Reinforcement Learning Based Recommendation with Supervised Embedding

Dynamic Multi-Objective Optimization Framework with Interactive Evolution for Sequential Recommendation

RLRF4Rec: Reinforcement Learning from Recsys Feedback for Enhanced Recommendation Reranking

Learning Reinforced Dynamic Representations for Sequential Recommendation

Sequential Search with Off-Policy Reinforcement Learning

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Multi-Agent RL-based Information Selection Model for Sequential Recommendation

Self-Supervised Reinforcement Learning for Recommender Systems

Learning Reinforced Dynamic Representations for Sequential Recommendation.

Enhancing Sequential Recommendations through Multi-Perspective Reflections and Iteration

DELRec: Distilling Sequential Pattern to Enhance LLMs-based Sequential Recommendation

Top-aware reinforcement learning based recommendation

Sim2Rec: A Simulator-based Decision-making Approach to Optimize Real-World Long-term User Engagement in Sequential Recommender Systems

Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems

Intrinsically Motivated Reinforcement Learning Based Recommendation with Counterfactual Data Augmentation