Abstract:Contrastive Learning (CL) has achieved impressive performance in self-supervised learning tasks, showing superior generalization ability. Inspired by the success, adopting CL into collaborative filtering (CF) is prevailing in semi-supervised top-K recommendations. The basic idea is to routinely conduct heuristic-based data augmentation and apply contrastive losses (e.g., InfoNCE) on the augmented views. Yet, some CF-tailored challenges make this adoption suboptimal, such as the issue of out-of-distribution, the risk of false negatives, and the nature of top-K evaluation. They necessitate the CL-based CF scheme to focus more on mining hard negatives and distinguishing false negatives from the vast unlabeled user-item interactions, for informative contrast signals. Worse still, there is limited understanding of contrastive loss in CF methods, especially w.r.t. its generalization ability. To bridge the gap, we delve into the reasons underpinning the success of contrastive loss in CF, and propose a principled Adversarial InfoNCE loss (AdvInfoNCE), which is a variant of InfoNCE, specially tailored for CF methods. AdvInfoNCE adaptively explores and assigns hardness to each negative instance in an adversarial fashion and further utilizes a fine-grained hardness-aware ranking criterion to empower the recommender's generalization ability. Training CF models with AdvInfoNCE, we validate the effectiveness of AdvInfoNCE on both synthetic and real-world benchmark datasets, thus showing its generalization ability to mitigate out-of-distribution problems. Given the theoretical guarantees and empirical superiority of AdvInfoNCE over most contrastive loss functions, we advocate its adoption as a standard loss in recommender systems, particularly for the out-of-distribution tasks. Codes are available at <a class="link-external link-https" href="https://github.com/LehengTHU/AdvInfoNCE" rel="external noopener nofollow">this https URL</a>.

Debiased Contrastive Loss for Collaborative Filtering.

PopDCL: Popularity-aware Debiased Contrastive Loss for Collaborative Filtering

Contrastive Learning for Recommender System

Incorporating Bias-aware Margins into Contrastive Loss for Collaborative Filtering

Improving Recommendations With Collaborative Factors

A unified latent factor correction scheme for collaborative filtering

Empowering Collaborative Filtering with Principled Adversarial Contrastive Loss

Online Collaborative Filtering With Implicit Feedback

Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering

SimpleX: A Simple and Strong Baseline for Collaborative Filtering

SimCE: Simplifying Cross-Entropy Loss for Collaborative Filtering

Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)

Learning-Efficient Yet Generalizable Collaborative Filtering for Item Recommendation

Unifying Graph Convolution and Contrastive Learning in Collaborative Filtering

Soft Contrastive Learning for Implicit Feedback Recommendations

Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems

Multi-Margin Cosine Loss: Proposal and Application in Recommender Systems

uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering

Deep Item-based Collaborative Filtering for Sparse Implicit Feedback

Collaborative Factorization For Recommender Systems