Abstract:Recommendation systems play an important role in alleviating the information overload issue. Generally, a recommendation model is trained to discern between positive (liked) and negative (disliked) instances for each user. However, under the open-world assumption, there are only positive instances but no negative instances from users’ implicit feedback, which poses the imbalanced learning challenge of lacking negative samples. To address this, two types of learning strategies have been proposed before, the negative sampling strategy and non-sampling strategy. The first strategy samples negative instances from missing data (i.e., unlabeled data), while the non-sampling strategy regards all the missing data as negative. Although learning strategies are known to be essential for algorithm performance, the in-depth comparison of negative sampling and non-sampling has not been sufficiently explored by far. To bridge this gap, we systematically analyze the role of negative sampling and non-sampling for implicit recommendation in this work. Specifically, we first theoretically revisit the objection of negative sampling and non-sampling. Then, with a careful setup of various representative recommendation methods, we explore the performance of negative sampling and non-sampling in different scenarios. Our results empirically show that although negative sampling has been widely applied to recent recommendation models, it is non-trivial for uniform sampling methods to show comparable performance to non-sampling learning methods. Finally, we discuss the scalability and complexity of negative sampling and non-sampling and present some open problems and future research topics that are worth being further explored.

On the Reconstruction Method for Negative Surveys with Application to Education Surveys.

Estimating Positive Surveys from Negative Surveys

Reconstructing Positive Surveys From Negative Surveys With Background Knowledge

On Consistency in Multiquestion Negative Surveys with Application to Healthcare Data Collection.

On the dependable level of the negative survey

Enhancing the Privacy of Negative Surveys Using Negative Combined Categories

Fast searching optimal negative surveys

Improvement of Negative Selection Algorithm Based on Hamming Distance

Negative Sampling in Recommendation: A Survey and Future Directions

On Location and Trace Privacy of the Moving Object Using the Negative Survey

An application of negative binomial distribution of order k in sensitive surveys

A Privacy-Preserving Aggregation Scheme Based on Immunological Negative Surveys for Smart Meters

Distribution of Non-responses in Chinese Political Survey Research

A Novel Negative Location Collection Method for Finding Aggregated Locations

Revisiting Negative Sampling Vs. Non-sampling in Implicit Recommendation

Real-Valued Negative Databases

A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys

A Method for Surveying Sensitivity Questions

Study on Reconstruction of the Lowest Cost-of-Living System in China with Negative Income Tax

ABNS: Association-based negative sampling for collaborative filtering

Adaptive Hardness Negative Sampling for Collaborative Filtering