Abstract:Self-supervision learning (SSL) has shown exceptionally promising results in natural language processing and, more recently, in image classification and recognition. Recent research works have demonstrated SSL's benefits on large unlabeled datasets. However, relatively little investigation has been done into how well it works with smaller datasets. Typically, this challenge entails training a model on a very small quantity of data and then evaluating the model on out-of-distribution data. Few-shot image classification aims to classify classes that haven't been seen before using a limited number of training examples. Recent few-shot learning research focuses on developing good representation models that can quickly adapt to test tasks. In this paper, we investigate the role of self-supervision in the context of few-shot learning. We devised a model that improves the network's representation learning by employing a self-supervised auxiliary task that is based on composite rotation. We propose a composite rotation-based auxiliary task that rotates the image on two levels: inner and outer, and assigns one of 16 rotation classes to the modified image. Then, we further trained our model, which enables us to capture the robust learnable features that assist in focusing on better visual details of an object present in the given image. We find that the network is able to learn to extract more generalized and discriminative features, which in turn helps to enhance the effectiveness of its few-shot classification. This approach significantly outperforms the state-of-the-art on several public benchmarks. In addition, we demonstrated empirically that models trained using the proposed approach perform better than the baseline model even when the query examples in the episode are not aligned with the support examples. Extensive ablation experiments are performed to validate the various components of our approach. We also investigate our strategy's impact on the network's ability to discriminate visual features.

Improving Few-Shot Learning with Auxiliary Self-Supervised Pretext Tasks

Improving Few-shot Text Classification via Pretrained Language Representations

Three-Dimension Attention Mechanism and Self-Supervised Pretext Task for Augmenting Few-Shot Learning

Improving In-Context Few-Shot Learning via Self-Supervised Training

Self-Supervison with data-augmentation improves few-shot learning

Pareto Self-Supervised Training for Few-Shot Learning

Boosting Supervision with Self-Supervision for Few-shot Learning

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

Less is More: A Closer Look at Semantic-based Few-Shot Learning

Few-Shot Image Classification via Contrastive Self-Supervised Learning

Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

Task-Level Self-Supervision for Cross-Domain Few-Shot Learning

When Does Self-supervision Improve Few-Shot Learning?

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

Self-Supervision Can Be a Good Few-Shot Learner

Learning to Self-Train for Semi-Supervised Few-Shot Classification.

STraTA: Self-Training with Task Augmentation for Better Few-shot Learning

ESPT: A Self-Supervised Episodic Spatial Pretext Task for Improving Few-Shot Learning

Self-Supervised Task Augmentation for Few-Shot Intent Detection

SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning