Abstract:Sequential recommendation is one of the most important tasks in recommender systems, which aims to recommend the next interacted item with historical behaviors as input. Traditional sequential recommendation always mainly considers the collected positive feedback such as click, purchase, etc. However, in short-video platforms such as TikTok, video viewing behavior may not always represent positive feedback. Specifically, the videos are played automatically, and users passively receive the recommended videos. In this new scenario, users passively express negative feedback by skipping over videos they do not like, which provides valuable information about their preferences. Different from the negative feedback studied in traditional recommender systems, this passive-negative feedback can reflect users' interests and serve as an important supervision signal in extracting users' preferences. Therefore, it is essential to carefully design and utilize it in this novel recommendation scenario. In this work, we first conduct analyses based on a large-scale real-world short-video behavior dataset and illustrate the significance of leveraging passive feedback. We then propose a novel method that deploys the sub-interest encoder, which incorporates positive feedback and passive-negative feedback as supervision signals to learn the user's current active sub-interest. Moreover, we introduce an adaptive fusion layer to integrate various sub-interests effectively. To enhance the robustness of our model, we then introduce a multi-task learning module to simultaneously optimize two kinds of feedback -- passive-negative feedback and traditional randomly-sampled negative feedback. The experiments on two large-scale datasets verify that the proposed method can significantly outperform state-of-the-art approaches. The code is released at <a class="link-external link-https" href="https://github.com/tsinghua-fib-lab/RecSys2023-SINE" rel="external noopener nofollow">this https URL</a>.

Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning

Deep Reinforcement Learning for List-wise Recommendations

Learning from Negative User Feedback and Measuring Responsiveness for Sequential Recommenders

A Deep Reinforcement Learning Based Long-Term Recommender System

Online Collaborative Filtering With Implicit Feedback

Negative Feedback Aware Hybrid Sequential Neural Recommendation Model.

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Unbiased Pairwise Learning from Implicit Feedback for Recommender Systems without Biased Variance Control

A stable deep reinforcement learning framework for recommendation

Understanding and Modeling Passive-Negative Feedback for Short-video Sequential Recommendation

Deep Learning Based Recommender System

Rethinking Offline Reinforcement Learning for Sequential Recommendation from A Pair-Wise Q-Learning Perspective

Diversity-Promoting Deep Reinforcement Learning for Interactive Recommendation

Recommender systems enhancement using deep reinforcement learning

Learning Robust Recommender from Noisy Implicit Feedback

Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendation

Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling

Denoising Implicit Feedback for Recommendation

Optimizing Ranking Algorithm in Recommender System Via Deep Reinforcement Learning

DLRRS: A New Recommendation System Based on Double Linear Regression Models

Robust Reinforcement Learning Objectives for Sequential Recommender Systems