Abstract:<p>Semi-supervised learning has largely alleviated the strong demand for large amount of annotations in deep learning. However, most of the methods have adopted a common assumption that there is always labeled data from the same class of unlabeled data, which is impractical and restricted for real-world applications. In this research work, our focus is on semi-supervised learning when the categories of unlabeled data and labeled data are disjoint from each other. The main challenge is how to effectively leverage knowledge in labeled data to unlabeled data when they are independent from each other, and not belonging to the same categories. Previous state-of-the-art methods have proposed to construct pairwise similarity pseudo labels as supervising signals. However, two issues commonly inherent in these methods: (1) All of previous methods are comprised of multiple training phases, which makes it difficult to train the model in an end-to-end fashion. (2) Strong dependence on the quality of pairwise similarity pseudo labels limits the performance as pseudo labels are vulnerable to noise and bias. Therefore, we propose to exploit the use of self-supervision as auxiliary task during model training such that labeled data and unlabeled data will share the same set of surrogate labels and overall supervising signals can have strong regularization. By doing so, all modules in the proposed algorithm can be trained simultaneously, which will boost the learning capability as end-to-end learning can be achieved. Moreover, we propose to utilize local structure information in feature space during pairwise pseudo label construction, as local properties are more robust to noise. Extensive experiments have been conducted on three frequently used visual datasets, i.e., CIFAR-10, CIFAR-100 and SVHN, in this paper. Experiment results have indicated the effectiveness of our proposed algorithm as we have achieved new state-of-the-art performance for novel visual categories learning for these three datasets.</p>

Learning from Noisy Web Data with Category-Level Supervision

Webly Supervised Learning with Category-level Semantic Information

Webly-Supervised Fine-Grained Visual Categorization Via Deep Domain Adaptation.

Fine-grained Category Discovery under Coarse-grained Supervision with Hierarchical Weighted Self-contrastive Learning

Fine-grained Classification using Heterogeneous Web Data and Auxiliary Categories

End-to-end novel visual categories learning via auxiliary self-supervision

Augmenting Strong Supervision Using Web Data for Fine-Grained Categorization.

Self-Supervised Noisy Label Learning for Source-Free Unsupervised Domain Adaptation.

Webly Supervised Learning Meets Zero-shot Learning: A Hybrid Approach for Fine-Grained Classification

Webly-Supervised Fine-Grained Recognition with Partial Label Learning

Semi-supervised learning in large scale text categorization

Noise-Aware Fully Webly Supervised Object Detection.

Data Augmentation with Norm-Vae for Unsupervised Domain Adaptation

Web-Supervised Network with Softly Update-Drop Training for Fine-Grained Visual Classification.

Virtual Category Learning: A Semi-Supervised Learning Method for Dense Prediction with Extremely Limited Labels

CurriculumNet: Weakly Supervised Learning from Large-Scale Web Images

Learning to Transfer Under Unknown Noisy Environments - An Universal Weakly-Supervised Domain Adaptation Method.

Learning from Web Data Using Adversarial Discriminative Neural Networks for Fine-Grained Classification

OHD: An Online Category-aware Framework for Learning with Noisy Labels under Long-Tailed Distribution

Boosting Unsupervised Domain Adaptation with Soft Pseudo-label and Curriculum Learning