Abstract:Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consistent with the true user preference. Exposure bias refers to the fact that user interactions are dependent upon the partial items exposed to the user. Existing debiasing methods do not make full use of the system exposure data and suffer from sub-optimal recommendation performance and high variance. In this paper, we propose to debias sequential recommenders through Distributionally Robust Optimization (DRO) over system exposure data. The key idea is to utilize DRO to optimize the worst-case error over an uncertainty set to safeguard the model against distributional discrepancy caused by the exposure bias. The main challenge to apply DRO for exposure debiasing in SR lies in how to construct the uncertainty set and avoid the overestimation of user preference on biased samples. Moreover, how to evaluate the debiasing effect on biased test set is also an open question. To this end, we first introduce an exposure simulator trained upon the system exposure data to calculate the exposure distribution, which is then regarded as the nominal distribution to construct the uncertainty set of DRO. Then, we introduce a penalty to items with high exposure probability to avoid the overestimation of user preference for biased samples. Finally, we design a debiased self-normalized inverse propensity score (SNIPS) evaluator for evaluating the debiasing effect on the biased offline test set. We conduct extensive experiments on two real-world datasets to verify the effectiveness of the proposed methods. Experimental results demonstrate the superior exposure debiasing performance of proposed methods. Codes and data are available at \url{<a class="link-external link-https" href="https://github.com/nancheng58/DebiasedSR_DRO" rel="external noopener nofollow">this https URL</a>}.

User-Dependent Learning to Debias for Recommendation

Debiased Recommendation with User Feature Balancing

Correcting the User Feedback-Loop Bias for Recommendation Systems

Debias Can be Unreliable: Mitigating Bias Issue in Evaluating Debiasing Recommendation

AutoDebias: Learning to Debias for Recommendation

Uncovering the Propensity Identification Problem in Debiased Recommendations

Cross Pairwise Ranking for Unbiased Item Recommendation

Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations

Invariant Preference Learning for General Debiasing in Recommendation

Bilateral Self-unbiased Learning from Biased Implicit Feedback

Dually Enhanced Propensity Score Estimation in Sequential Recommendation

Propensity Matters: Measuring and Enhancing Balancing for Recommendation.

ReCRec: Reasoning the Causes of Implicit Feedback for Debiased Recommendation

Debiasing Sequential Recommenders through Distributionally Robust Optimization over System Exposure

Unbiased Sequential Recommendation with Latent Confounders

Relaxing the Accurate Imputation Assumption in Doubly Robust Learning for Debiased Collaborative Filtering

Addressing Unmeasured Confounder for Recommendation with Sensitivity Analysis

Debiased Recommendation with Noisy Feedback

Learning-to-rank debias with popularity-weighted negative sampling and popularity regularization

Debiasing Learning Based Cross-domain Recommendation

A Bias Study and an Unbiased Deep Neural Network for Recommender Systems