Abstract:Negative sampling is essential for implicit-feedback-based collaborative filtering, which is used to constitute negative signals from massive unlabeled data to guide supervised learning. The state-of-the-art idea is to utilize hard negative samples that carry more useful information to form a better decision boundary. To balance efficiency and effectiveness, the vast majority of existing methods follow the two-pass approach, in which the first pass samples a fixed number of unobserved items by a simple static distribution and then the second pass selects the final negative items using a more sophisticated negative sampling strategy. However, selecting negative samples from the original items is inherently restricted, and thus may not be able to contrast positive samples well. In this paper, we confirm this observation via experiments and introduce two limitations of existing solutions: ambiguous trap and information discrimination. Our response to such limitations is to introduce augmented negative samples. This direction renders a substantial technical challenge because constructing unconstrained negative samples may introduce excessive noise that distorts the decision boundary. To this end, we introduce a novel generic augmented negative sampling paradigm and provide a concrete instantiation. First, we disentangle hard and easy factors of negative items. Next, we generate new candidate negative samples by augmenting only the easy factors in a regulated manner: the direction and magnitude of the augmentation are carefully calibrated. Finally, we design an advanced negative sampling strategy to identify the final augmented negative samples, which considers not only the score function used in existing methods but also a new metric called augmentation gain. Extensive experiments on real-world datasets demonstrate that our method significantly outperforms state-of-the-art baselines.

Negative Samples Mining Matters: Reconsidering Hyperspectral Image Classification with Contrastive Learning

Enhancing Contrastive Learning with Positive Pair Mining for Few-shot Hyperspectral Image Classification

Rethinking Samples Selection for Contrastive Learning: Mining of Potential Samples

Debiased Graph Contrastive Learning.

Synthetic Hard Negative Samples for Contrastive Learning

Mining negative samples on contrastive learning via curricular weighting strategy

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

Contrastive Learning with Negative Sampling Correction

Hard Negative Sample Mining for Whole Slide Image Classification

Progressive Contrastive Learning Based on Noisy Negatives Cleaning for Hyperspectral Image Classification

Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning

M-Mix: Generating Hard Negatives via Multi-sample Mixing for Contrastive Learning

Two-Stream Networks for Contrastive Learning in Hyperspectral Image Classification

Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification

Hypergraph contrastive attention networks for hyperedge prediction with negative samples evaluation

Revisiting Hard Negative Mining in Contrastive Learning for Visual Understanding

Deep Spatial-Spectral Subspace Clustering for Hyperspectral Images Based on Contrastive Learning

When hard negative sampling meets supervised contrastive learning

Augmented Negative Sampling for Collaborative Filtering

Self-Supervised Contrastive Learning Residual Network for Hyperspectral Image Classification under Limited Labeled Samples