Abstract:Recommender system usually faces popularity bias issues: from the data perspective, items exhibit uneven (usually long-tail) distribution on the interaction frequency; from the method perspective, collaborative filtering methods are prone to amplify the bias by over-recommending popular items. It is undoubtedly critical to consider popularity bias in recommender systems, and existing work mainly eliminates the bias effect with propensity-based unbiased learning or causal embeddings. However, we argue that not all biases in the data are bad, \ie some items demonstrate higher popularity because of their better intrinsic quality. Blindly pursuing unbiased learning may remove the beneficial patterns in the data, degrading the recommendation accuracy and user satisfaction. This work studies an unexplored problem in recommendation --- how to leverage popularity bias to improve the recommendation accuracy. The key lies in two aspects: how to remove the bad impact of popularity bias during training, and how to inject the desired popularity bias in the inference stage that generates top-K recommendations. This questions the causal mechanism of the recommendation generation process. Along this line, we find that item popularity plays the role ofconfounder between the exposed items and the observed interactions, causing the bad effect of bias amplification. To achieve our goal, we propose a new training and inference paradigm for recommendation named Popularity-bias Deconfounding and Adjusting (PDA). It removes the confounding popularity bias in model training and adjusts the recommendation score with desired popularity bias via causal intervention. We demonstrate the new paradigm on the latent factor model and perform extensive experiments on three real-world datasets from Kwai, Douban, and Tencent. Empirical studies validate that the deconfounded training is helpful to discover user real interests and the inference adjustment with popularity bias could further improve the recommendation accuracy. We release our code at https://github.com/zyang1580/PDA.

Debiasing Recommenders Through Personalized Popularity-Aware Margins.

The Influence of Herd Mentality on Rating Bias and Popularity Bias: A Bi-Process Debiasing Recommendation Model Based on Matrix Factorization

Going Beyond Popularity and Positivity Bias: Correcting for Multifactorial Bias in Recommender Systems

Co-training Disentangled Domain Adaptation Network for Leveraging Popularity Bias in Recommenders

Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System

Causal Intervention for Leveraging Popularity Bias in Recommendation

Measuring and Mitigating Item Under-Recommendation Bias in Personalized Ranking Systems

Managing Popularity Bias in Recommender Systems with Personalized Re-ranking

User-centered Evaluation of Popularity Bias in Recommender Systems

Learning-to-rank debias with popularity-weighted negative sampling and popularity regularization

Popcorn: Human-in-the-loop Popularity Debiasing in Conversational Recommender Systems

Connecting User and Item Perspectives in Popularity Debiasing for Collaborative Recommendation

Metrics for popularity bias in dynamic recommender systems

Popularity Bias Is Not Always Evil: Disentangling Benign and Harmful Bias for Recommendation

AutoDebias: Learning to Debias for Recommendation

The Impact of Popularity Bias on Fairness and Calibration in Recommendation

A Survey on Popularity Bias in Recommender Systems

How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective

Multi-sided Exposure Bias in Recommendation

Recommendations as Treatments: Debiasing Learning and Evaluation

Potential Factors Leading to Popularity Unfairness in Recommender Systems: A User-Centered Analysis