Abstract:The increasing popularity of the recommender system deeply influences our decisions on the Internet, which is a typical continuous interaction process between the system and its users. Most previous recommender systems heavily focus on optimizing recommendation accuracy while neglecting the other important aspects of recommendation quality, such as diversity of recommendation list. In this study, we propose a novel recommendation framework to optimize the recommendation list for the Top-N task, named Collaborative Filtering-based Deep Reinforcement Learning (CFDRL), which promotes the diversity of recommendation results without sacrificing the recommendation accuracy. More specifically, to effectively capture the continuous user-item interaction for recommendations, we adopt the deep reinforcement learning (DRL) to update the recommendation strategy dynamically according to the user’s real-time feedback. Meanwhile, to generate diverse and complementary items for recommendation, we design a diversity-aware reward function that can lead to maximizing reward with the trade-off between diversity and accuracy. Besides, to alleviate the disadvantage of DQN that directly picking the recommendations with the highest Q-values from the unselected items, we define a modified ε$$\varepsilon$$-greedy explore policy with jointly CF model. It firstly utilizes CF model to sort the items and divide them into two part according to the item similarity, then with a probability the agent selects from them and generates an action list with the modified ε$$\varepsilon$$-greedy explore policy. The experimental results conducted on two real-world e-commerce datasets demonstrate the effectiveness of the proposed model.

Avoiding monotony: improving the diversity of recommendation lists

Novelty and Diversity in Top-N Recommendation - Analysis and Evaluation

Covering Diversification and Fairness for Better Recommendation (Short Paper).

Evaluating the Diversity of Top-N Recommendations

Improving Topic Diversity in Recommendation Lists: Marginally or Proportionally?

Novel Item Recommendation by User Profile Partitioning

A Framework for Recommending Relevant and Diverse Items

A Personalized Recommendation Algorithm Via Biased Random Walk

DUM: Diversity-Weighted Utility Maximization for Recommendations

Statistical Modeling of Diversity in Top-N Recommender Systems

Promoting Diversity in Recommendation by Entropy Regularizer

Selection Bias Mitigation in Recommender System Using Uninteresting Items Based on Temporal Visibility.

Recommending the long tail items through personalized diversification

A Double-Ranking Strategy for Long-Tail Product Recommendation.

Niche Product Retrieval in Top-N Recommendation

Accurate and Diverse Recommendations Via Eliminating Redundant Correlations

Diversity-Aware Top-N Recommendation: A Deep Reinforcement Learning Way

User Interest Dynamics on Personalized Recommendation

Performance of recommender algorithms on top-n recommendation tasks

Reinforcement Learning To Diversify Top-N Recommendation

A joint optimization approach for personalized recommendation diversification