Abstract:Recommender system usually faces popularity bias. From the popularity distribution shift perspective, the normal paradigm trained on exposed items (most are hot items) identifies that recommending popular items more frequently can achieve lower loss, thus injecting popularity information into item property embedding, e.g., id embedding. From the long-tail distribution shift perspective, the sparse interactions of long-tail items lead to insufficient learning of them. The resultant distribution discrepancy between hot and long-tail items would not only inherit the bias, but also amplify the bias. Existing work addresses this issue with inverse propensity scoring (IPS) or causal embeddings. However, we argue that not all popularity biases mean bad effects, i.e., some items show higher popularity due to better quality or conform to current trends, which deserve more recommendations. Blindly seeking unbiased learning may inhibit high-quality or fashionable items. To make better use of the popularity bias, we propose a co-training disentangled domain adaptation network (CD$^2$AN), which can co-train both biased and unbiased models. Specifically, for popularity distribution shift, CD$^2$AN disentangles item property representation and popularity representation from item property embedding. For long-tail distribution shift, we introduce additional unexposed items (most are long-tail items) to align the distribution of hot and long-tail item property representations. Further, from the instances perspective, we carefully design the item similarity regularization to learn comprehensive item representation, which encourages item pairs with more effective co-occurrences patterns to have more similar item property representations. Based on offline evaluations and online A/B tests, we show that CD$^2$AN outperforms the existing debiased solutions. Currently, CD$^2$AN has been successfully deployed at Mobile Taobao App and handling major online traffic.

LightAD:accelerating AutoDebias with Adaptive Sampling

AutoDebias: Learning to Debias for Recommendation

Co-training Disentangled Domain Adaptation Network for Leveraging Popularity Bias in Recommenders

Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback

ADASS: Adaptive Sample Selection for Training Acceleration

Adaptive debiased SGD in high-dimensional GLMs with streaming data

Self-Sampling Training and Evaluation for the Accuracy-Bias Tradeoff in Recommendation

DELTA: DEBIASED FULLY TEST-TIME ADAPTATION

Debiased Recommendation with User Feature Balancing

Learning to Auto Weight: Entirely Data-Driven and Highly Efficient Weighting Framework

LSAB: User Behavioral Pattern Modeling in Sequential Recommendation by Learning Self-Attention Bias

Automatic Fairness Testing of Neural Classifiers through Adversarial Sampling

Fast Model Debias with Machine Unlearning

Reducing Bias in Deep Learning Optimization: The RSGDM Approach

LightAdam: Towards a Fast and Accurate Adaptive Momentum Online Algorithm

Disentangled variational auto-encoder enhanced by counterfactual data for debiasing recommendation

AdapFair: Ensuring Continuous Fairness for Machine Learning Operations

Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization

Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations

AA-DLADMM: An Accelerated ADMM-based Framework for Training Deep Neural Networks

Towards Automated Negative Sampling in Implicit Recommendation