Abstract:<p>Semi-supervised learning has largely alleviated the strong demand for large amount of annotations in deep learning. However, most of the methods have adopted a common assumption that there is always labeled data from the same class of unlabeled data, which is impractical and restricted for real-world applications. In this research work, our focus is on semi-supervised learning when the categories of unlabeled data and labeled data are disjoint from each other. The main challenge is how to effectively leverage knowledge in labeled data to unlabeled data when they are independent from each other, and not belonging to the same categories. Previous state-of-the-art methods have proposed to construct pairwise similarity pseudo labels as supervising signals. However, two issues commonly inherent in these methods: (1) All of previous methods are comprised of multiple training phases, which makes it difficult to train the model in an end-to-end fashion. (2) Strong dependence on the quality of pairwise similarity pseudo labels limits the performance as pseudo labels are vulnerable to noise and bias. Therefore, we propose to exploit the use of self-supervision as auxiliary task during model training such that labeled data and unlabeled data will share the same set of surrogate labels and overall supervising signals can have strong regularization. By doing so, all modules in the proposed algorithm can be trained simultaneously, which will boost the learning capability as end-to-end learning can be achieved. Moreover, we propose to utilize local structure information in feature space during pairwise pseudo label construction, as local properties are more robust to noise. Extensive experiments have been conducted on three frequently used visual datasets, i.e., CIFAR-10, CIFAR-100 and SVHN, in this paper. Experiment results have indicated the effectiveness of our proposed algorithm as we have achieved new state-of-the-art performance for novel visual categories learning for these three datasets.</p>

Fine-grained Category Discovery under Coarse-grained Supervision with Hierarchical Weighted Self-contrastive Learning

Fine-Grained Visual Categorization With Fine-Tuned Segmentation

Hierarchical Self-Distilled Feature Learning for Fine-Grained Visual Categorization

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

DOWN: Dynamic Order Weighted Network for Fine-grained Category Discovery

Learning Contrastive Self-Distillation for Ultra-Fine-Grained Visual Categorization Targeting Limited Samples

A Generic Method for Fine-grained Category Discovery in Natural Language Texts

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Cross-Level Multi-Instance Distillation for Self-Supervised Fine-Grained Visual Categorization

Novel Class Discovery for Ultra-Fine-Grained Visual Categorization

HCL: Hierarchical Consistency Learning for Webly Supervised Fine-Grained Recognition

Multiple Granularity Descriptors for Fine-Grained Categorization.

Webly-Supervised Fine-Grained Visual Categorization Via Deep Domain Adaptation.

A Survey on Fine-grained Image Categorization Using Deep Convolutional Features

Semi-Supervised Fine-Grained Image Categorization Using Transfer Learning with Hierarchical Multi-Scale Adversarial Networks

Category-specific Semantic Coherency Learning for Fine-grained Image Recognition

Part Attentioned Fine-Grained Categorization Using Context Sensitive Flow

End-to-end novel visual categories learning via auxiliary self-supervision

Coarse Helps Fine: A Multi-Granularity Discriminative Adversarial Network for Fine-Grained Open-Set Domain Adaptation.

Multi-level Dictionary Learning for Fine-Grained Images Categorization with Attention Model

Label Hierarchy Constraint Network for Fine-grained Classification