Abstract:Recommender systems that overly focus on short-term engagement prevents users from exploring diverse interests. To tackle this challenge, numerous diversification algorithms have been proposed. These algorithms typically rely on measures of item similarity, aiming to maximize the dissimilarity across items in the final set of recommendations. In this work, we demonstrate the benefits of going beyond item-level similarities by utilizing higher-level user understanding--specifically, user intents that persist across multiple interactions or recommendation sessions--in diversification. Our approach is motivated by the observation that user behaviors on online platforms are largely driven by their underlying intents. Therefore, final recommendations should ensure that a diverse set of intents is accurately represented. While user intent has primarily been studied in the context of search, it is less clear how to incorporate real-time dynamic intent predictions in recommender systems. To address this gap, we develop a probabilistic intent-based whole-page diversification framework for the final stage of a recommender system. Starting with a prior belief of user intents, the proposed framework sequentially selects items for each position based on these beliefs and subsequently updates posterior beliefs about the intents. This approach ensures that different user intents are represented on a page, towards optimizing long-term user experience. We experiment with the intent diversification framework on YouTube. Live experiments on a diverse set of intents show that our framework increases Daily Active Users and overall user enjoyment, validating its effectiveness in facilitating long-term planning. Specifically, it enables users to consistently discover and engage with diverse content that aligns with their underlying intents over time, leading to an improved long-term user experience.

Performative Recommendation: Diversifying Content via Strategic Incentives

Covering Diversification and Fairness for Better Recommendation (Short Paper).

Recommending to Strategic Users

Performative Debias with Fair-exposure Optimization Driven by Strategic Agents in Recommender Systems

Diversity-Promoting Deep Reinforcement Learning for Interactive Recommendation

Promoting Diversity in Recommendation by Entropy Regularizer

Diversify or Not: Dynamic Diversification for Personalized Recommendation

Diversity in Network-Friendly Recommendations

Relieving Popularity Bias in Interactive Recommendation: A Diversity-Novelty-Aware Reinforcement Learning Approach

Representation Online Matters: Practical End-to-End Diversification in Search and Recommender Systems

Improving End-to-End Sequential Recommendations with Intent-aware Diversification

Beyond Item Dissimilarities: Diversifying by Intent in Recommender Systems

Incentivizing High-Quality Content in Online Recommender Systems

Sequential Recommendation with Controllable Diversification: Representation Degeneration and Diversity

Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations

DUM: Diversity-Weighted Utility Maximization for Recommendations

Reconciling the accuracy-diversity trade-off in recommendations

A Joint Optimization Approach for Personalized Recommendation Diversification.

Recommenders with a mission: assessing diversity in newsrecommendations

Improving ranking function and diversification in interactive recommendation systems based on deep reinforcement learning

Novelty and Diversity in Top-N Recommendation - Analysis and Evaluation