Abstract:Recommendation systems play an important role in alleviating the information overload issue. Generally, a recommendation model is trained to discern between positive (liked) and negative (disliked) instances for each user. However, under the open-world assumption, there are only positive instances but no negative instances from users’ implicit feedback, which poses the imbalanced learning challenge of lacking negative samples. To address this, two types of learning strategies have been proposed before, the negative sampling strategy and non-sampling strategy. The first strategy samples negative instances from missing data (i.e., unlabeled data), while the non-sampling strategy regards all the missing data as negative. Although learning strategies are known to be essential for algorithm performance, the in-depth comparison of negative sampling and non-sampling has not been sufficiently explored by far. To bridge this gap, we systematically analyze the role of negative sampling and non-sampling for implicit recommendation in this work. Specifically, we first theoretically revisit the objection of negative sampling and non-sampling. Then, with a careful setup of various representative recommendation methods, we explore the performance of negative sampling and non-sampling in different scenarios. Our results empirically show that although negative sampling has been widely applied to recent recommendation models, it is non-trivial for uniform sampling methods to show comparable performance to non-sampling learning methods. Finally, we discuss the scalability and complexity of negative sampling and non-sampling and present some open problems and future research topics that are worth being further explored.

Region or Global A Principle for Negative Sampling in Graph-based Recommendation

MixGCF

Reinforcement negative sampling recommendation based on collaborative knowledge graph

Understanding Negative Sampling in Graph Representation Learning

Neighborhood-based Hard Negative Mining for Sequential Recommendation

ENSG: Enhancing Negative Sampling in Graph Convolutional Networks for Recommendation Systems

Dynamic negative sampling for recommendation with feature matching

User Multi-behavior Enhanced POI Recommendation with Efficient and Informative Negative Sampling.

Generating Negative Samples for Sequential Recommendation

NS4AR: A new, focused on sampling areas sampling method in graphical recommendation Systems

Negative Sampling in Recommendation: A Survey and Future Directions

ABNS: Association-based negative sampling for collaborative filtering

Reinforced Negative Sampling over Knowledge Graph for Recommendation

Bayesian Negative Sampling for Recommendation

Revisiting Negative Sampling Vs. Non-sampling in Implicit Recommendation

MixDec Sampling: A Soft Link-based Sampling Method of Graph Neural Network for Recommendation

Negative Can Be Positive: Signed Graph Neural Networks for Recommendation

Does Negative Sampling Matter? A Review with Insights into its Theory and Applications

Reinforced Negative Sampling for Recommendation with Exposure Data

On the Theories Behind Hard Negative Sampling for Recommendation

Diffusion-based Negative Sampling on Graphs for Link Prediction