Abstract:Recent studies on pre-trained vision/language models have demonstrated the practical benefit of a new, promising solution-building paradigm in AI where models can be pre-trained on broad data describing a generic task space and then adapted successfully to solve a wide range of downstream tasks, even when training data is severely limited (e.g., in zero- or few-shot learning scenarios). Inspired by such progress, we investigate in this paper the possibilities and challenges of adapting such a paradigm to the context of recommender systems, which is less investigated from the perspective of pre-trained model. In particular, we propose to develop a generic recommender that captures universal interaction patterns by training on generic user-item interaction data extracted from different domains, which can then be fast adapted to improve few-shot learning performance in unseen new domains (with limited data). However, unlike vision/language data which share strong conformity in the semantic space, universal patterns underlying recommendation data collected across different domains (e.g., different countries or different E-commerce platforms) are often occluded by both in-domain and cross-domain biases implicitly imposed by the cultural differences in their user and item bases, as well as their uses of different e-commerce platforms. As shown in our experiments, such heterogeneous biases in the data tend to hinder the effectiveness of the pre-trained model. To address this challenge, we further introduce and formalize a causal debiasing perspective, which is substantiated via a hierarchical Bayesian deep learning model, named PreRec. Our empirical studies on real-world data show that the proposed model could significantly improve the recommendation performance in zero- and few-shot learning settings under both cross-market and cross-platform scenarios.

Recommendations as Treatments: Debiasing Learning and Evaluation

Invariant Preference Learning for General Debiasing in Recommendation

Combating Selection Biases in Recommender Systems with a Few Unbiased Ratings

Going Beyond Popularity and Positivity Bias: Correcting for Multifactorial Bias in Recommender Systems

Debias Can be Unreliable: Mitigating Bias Issue in Evaluating Debiasing Recommendation

Modeling and Counteracting Exposure Bias in Recommender Systems

Pre-trained Recommender Systems: A Causal Debiasing Perspective

Self-Sampling Training and Evaluation for the Accuracy-Bias Tradeoff in Recommendation

AutoDebias: Learning to Debias for Recommendation

Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations

A two-step Recommendation Algorithm via Iterative Local Least Squares

The Influence of Herd Mentality on Rating Bias and Popularity Bias: A Bi-Process Debiasing Recommendation Model Based on Matrix Factorization

ReCRec: Reasoning the Causes of Implicit Feedback for Debiased Recommendation

The Importance of Cognitive Biases in the Recommendation Ecosystem

Bias and Debias in Recommender System: A Survey and Future Directions

Transparency, Privacy, and Fairness in Recommender Systems

Causal Embeddings for Recommendation: An Extended Abstract

Bilateral Self-unbiased Learning from Biased Implicit Feedback

Detecting Sponsored Recommendations

Causal Disentanglement with Network Information for Debiased Recommendations

Break Out of a Pigeonhole: A Unified Framework for Examining Miscalibration, Bias, and Stereotype in Recommender Systems