Abstract:Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This is especially problematic when bias is amplified over time as a few items (e.g., popular ones) are repeatedly over-represented in recommendation lists and users' interactions with those items will amplify bias towards those items over time resulting in a feedback loop. This issue has been extensively studied in the literature on model-based or neighborhood-based recommendation algorithms, but less work has been done on online recommendation models, such as those based on top-K contextual bandits, where recommendation models are dynamically updated with ongoing user feedback. In this paper, we study exposure bias in a class of well-known contextual bandit algorithms known as Linear Cascading Bandits. We analyze these algorithms on their ability to handle exposure bias and provide a fair representation for items in the recommendation results. Our analysis reveals that these algorithms tend to amplify exposure disparity among items over time. In particular, we observe that these algorithms do not properly adapt to the feedback provided by the users and frequently recommend certain items even when those items are not selected by users. To mitigate this bias, we propose an Exposure-Aware (EA) reward model that updates the model parameters based on two factors: 1) user feedback (i.e., clicked or not), and 2) position of the item in the recommendation list. This way, the proposed model controls the utility assigned to items based on their exposure in the recommendation list. Extensive experiments on two real-world datasets using three contextual bandit algorithms show that the proposed reward model reduces exposure bias amplification in long run while maintaining the recommendation accuracy.

The Impact of Situation Clustering in Contextual-Bandit Algorithm for Context-Aware Recommender Systems

A Novel Framework to Alleviate the Sparsity Problem in Context-Aware Recommender Systems

Situation-Aware Approach to Improve Context-based Recommender System

Graph Clustering Bandits for Recommendation.

Dynamic Context Management in Context-Aware Recommender Systems.

Context-Aware Bandits

Exploiting Structural and Temporal Influence for Dynamic Social-Aware Recommendation

On Context-Dependent Clustering of Bandits.

Collaborative Filtering Bandits

Context-Aware Collaborative Filtering Framework for Rating Prediction Based on Novel Similarity Estimation

A Contextual-Bandit Approach to Personalized News Article Recommendation

Context-Aware Collaborative Topic Regression with Social Matrix Factorization for Recommender Systems

Online Clustering of Contextual Cascading Bandits

Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms

Improving adaptation of ubiquitous recommander systems by using reinforcement learning and collaborative filtering

Learning Contextual Bandits in a Non-stationary Environment

Neural Contextual Bandits for Personalized Recommendation

Context-Aware Recommender Systems: Challenges and Opportunities

Fast Distributed Bandits for Online Recommendation Systems

Meta Clustering of Neural Bandits

Exposure-Aware Recommendation using Contextual Bandits