Abstract:Recommender system usually faces popularity bias issues: from the data perspective, items exhibit uneven (usually long-tail) distribution on the interaction frequency; from the method perspective, collaborative filtering methods are prone to amplify the bias by over-recommending popular items. It is undoubtedly critical to consider popularity bias in recommender systems, and existing work mainly eliminates the bias effect with propensity-based unbiased learning or causal embeddings. However, we argue that not all biases in the data are bad, \ie some items demonstrate higher popularity because of their better intrinsic quality. Blindly pursuing unbiased learning may remove the beneficial patterns in the data, degrading the recommendation accuracy and user satisfaction. This work studies an unexplored problem in recommendation --- how to leverage popularity bias to improve the recommendation accuracy. The key lies in two aspects: how to remove the bad impact of popularity bias during training, and how to inject the desired popularity bias in the inference stage that generates top-K recommendations. This questions the causal mechanism of the recommendation generation process. Along this line, we find that item popularity plays the role ofconfounder between the exposed items and the observed interactions, causing the bad effect of bias amplification. To achieve our goal, we propose a new training and inference paradigm for recommendation named Popularity-bias Deconfounding and Adjusting (PDA). It removes the confounding popularity bias in model training and adjusts the recommendation score with desired popularity bias via causal intervention. We demonstrate the new paradigm on the latent factor model and perform extensive experiments on three real-world datasets from Kwai, Douban, and Tencent. Empirical studies validate that the deconfounded training is helpful to discover user real interests and the inference adjustment with popularity bias could further improve the recommendation accuracy. We release our code at https://github.com/zyang1580/PDA.

Invariant representation learning to popularity distribution shift for recommendation

Invariant Collaborative Filtering to Popularity Distribution Shift

Co-training Disentangled Domain Adaptation Network for Leveraging Popularity Bias in Recommenders

Discriminative-Invariant Representation Learning for Unbiased Recommendation.

Pareto Invariant Representation Learning for Multimedia Recommendation

Causal Intervention for Leveraging Popularity Bias in Recommendation

Invariant representation learning for sequential recommendation

Relieving Popularity Bias in Interactive Recommendation: A Diversity-Novelty-Aware Reinforcement Learning Approach

Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendation

Invariant Preference Learning for General Debiasing in Recommendation

Popularity Bias Is Not Always Evil: Disentangling Benign and Harmful Bias for Recommendation

Causal Representation Learning for Out-of-Distribution Recommendation

Enhancing Disentanglement of Popularity Bias for Recommendation with Triplet Contrastive Learning

Towards Long-term Fairness in Recommendation

Retrieval and Distill: A Temporal Data Shift-Free Paradigm for Online Recommendation System

Interpolative Distillation for Unifying Biased and Debiased Recommendation

Learning Fair Representations for Recommendation: A Graph-based Perspective

Disentangling User Interest and Popularity Bias for Recommendation with Causal Embedding

Connecting User and Item Perspectives in Popularity Debiasing for Collaborative Recommendation

CausPref: Causal Preference Learning for Out-of-Distribution Recommendation.

Disentangled Dynamic Graph Attention Network for Out-of-distribution Sequential Recommendation