Abstract:Sequential recommendations play a crucial role in many real-world applications. Due to the sequential nature, reinforcement learning has been employed to iteratively produce recommendations based on an observed stream of user behavior. In this setting, a recommendation agent interacts with the environments (users) by sequentially recommending items (actions) to maximize users' overall long-term cumulative rewards. However, most reinforcement learning-based recommendation models only focus on extrinsic rewards based on user feedback, leading to sub-optimal policies if user-item interactions are sparse and fail to obtain the dynamic rewards based on the users' preferences. As a remedy, we propose a dynamic intrinsic reward signal integrated with a contrastive discriminator-augmented reinforcement learning framework. Concretely, our framework contains two modules: (1) a contrastive learning module is employed to learn the representation of item sequences; (2) an intrinsic reward learning function to imitate the user's internal dynamics. Furthermore, we combine static extrinsic reward and dynamic intrinsic reward to train a sequential recommender system based on double Q-learning. We integrate our framework with five representative sequential recommendation models. Specifically, our framework augments these recommendation models with two output layers: the supervised layer that applies cross-entropy loss to perform ranking and the other for reinforcement learning. Experimental results on two real-world datasets demonstrate that the proposed framework outperforms several sequential recommendation baselines and exploration with intrinsic reward baselines.

Deep Learning-Based Sequential Recommender Systems - Concepts, Algorithms, and Evaluations.

Deep Learning for Sequential Recommendation: Algorithms, Influential Factors, and Evaluations

Deep Learning Based Recommender System

A Survey of Sequential Recommendation Systems: Techniques, Evaluation, and Future Directions

AutoML for Deep Recommender Systems: Fundamentals and Advances.

Deep Learning based Recommender System: A Survey and New Perspectives

Double Attention Convolutional Neural Network for Sequential Recommendation.

Sequential Recommendation with Decomposed Item Feature Routing

Sequential/Session-based Recommendations: Challenges, Approaches, Applications and Opportunities

Deep Bi-LSTM Networks for Sequential Recommendation

Attention with Long-Term Interval-Based Deep Sequential Learning for Recommendation.

Learning the Dynamics in Sequential Recommendation by Exploiting Real-time Information

Data Augmentation Strategies for Improving Sequential Recommender Systems

Robust Reinforcement Learning Objectives for Sequential Recommender Systems

Dynamic Graph Neural Networks for Sequential Recommendation

CDARL: a contrastive discriminator-augmented reinforcement learning framework for sequential recommendations

Behavior-Dependent Linear Recurrent Units for Efficient Sequential Recommendation

A Comprehensive Survey on Automated Machine Learning for Recommendations

AutoSeqRec: Autoencoder for Efficient Sequential Recommendation

Deep reinforcement learning in recommender systems: A survey and new perspectives

Linear Recurrent Units for Sequential Recommendation