Abstract:Negative sampling methods are vital in implicit recommendation models as they allow us to obtain negative instances from massive unlabeled data. Most existing approaches focus on sampling hard negative samples in various ways. These studies are orthogonal to the recommendation model and implicit datasets. However, such an idea contradicts the common belief in AutoML that the model and dataset should be matched. Empirical experiments suggest that the best-performing negative sampler depends on the implicit dataset and the specific recommendation model. Hence, we propose a hypothesis that the negative sampler should align with the capacity of the recommendation models as well as the statistics of the datasets to achieve optimal performance. A mismatch between these three would result in sub-optimal outcomes. An intuitive idea to address the mismatch problem is to exhaustively select the best-performing negative sampler given the model and dataset. However, such an approach is computationally expensive and time-consuming, leaving the problem unsolved. In this work, we propose the AutoSample framework that adaptively selects the best-performing negative sampler among candidates. Specifically, we propose a loss-to-instance approximation to transform the negative sampler search task into the learning task over a weighted sum, enabling end-to-end training of the model. We also designed an adaptive search algorithm to extensively and efficiently explore the search space. A specific initialization approach is also obtained to better utilize the obtained model parameters during the search stage, which is similar to curriculum learning and leads to better performance and less computation resource consumption. We evaluate the proposed framework on four benchmarks over three models. Extensive experiments demonstrate the effectiveness and efficiency of our proposed framework.

May the Torcher Light Our Way: A Negative-Accelerated Active Learning Framework for Image Classification

Practice Makes Perfect: an Adaptive Active Learning Framework for Image Classification

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

Making the torch lighter: Areinforced active sampling framework for image classification.

Deep Adversarial Active Learning with Model Uncertainty for Image Classification

Active Deep Learning for Hyperspectral Image Classification With Uncertainty Learning

Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization

Cost-Effective Active Learning for Deep Image Classification

Towards Better Uncertainty Sampling: Active Learning With Multiple Views For Deep Convolutional Neural Network

Active learning for object-based image classification using predefined training objects

Positive Sample Enhanced Angle-Diversity Active Learning For Svm Based Image Retrieval

Uncertainty Assessment-Based Active Learning for Reliable Fire Detection Systems

Improve Cost Efficiency of Active Learning over Noisy Dataset

Towards Automated Negative Sampling in Implicit Recommendation

Adaptive Informative Sampling for Active Learning.

Active Negative Loss: A Robust Framework for Learning with Noisy Labels

Negative Bootstrapping for Weakly Supervised Target Detection in Remote Sensing Images

Active Learning with Optimal Distribution for Image Classification

Breaking the Barrier: Selective Uncertainty-based Active Learning for Medical Image Segmentation

Contrastive Open-set Active Learning based Sample Selection for Image Classification