Abstract:Self-supervision learning (SSL) has shown exceptionally promising results in natural language processing and, more recently, in image classification and recognition. Recent research works have demonstrated SSL's benefits on large unlabeled datasets. However, relatively little investigation has been done into how well it works with smaller datasets. Typically, this challenge entails training a model on a very small quantity of data and then evaluating the model on out-of-distribution data. Few-shot image classification aims to classify classes that haven't been seen before using a limited number of training examples. Recent few-shot learning research focuses on developing good representation models that can quickly adapt to test tasks. In this paper, we investigate the role of self-supervision in the context of few-shot learning. We devised a model that improves the network's representation learning by employing a self-supervised auxiliary task that is based on composite rotation. We propose a composite rotation-based auxiliary task that rotates the image on two levels: inner and outer, and assigns one of 16 rotation classes to the modified image. Then, we further trained our model, which enables us to capture the robust learnable features that assist in focusing on better visual details of an object present in the given image. We find that the network is able to learn to extract more generalized and discriminative features, which in turn helps to enhance the effectiveness of its few-shot classification. This approach significantly outperforms the state-of-the-art on several public benchmarks. In addition, we demonstrated empirically that models trained using the proposed approach perform better than the baseline model even when the query examples in the episode are not aligned with the support examples. Extensive ablation experiments are performed to validate the various components of our approach. We also investigate our strategy's impact on the network's ability to discriminate visual features.

Self-Supervison with data-augmentation improves few-shot learning

When Does Self-supervision Improve Few-Shot Learning?

Boosting Supervision with Self-Supervision for Few-shot Learning

Three-Dimension Attention Mechanism and Self-Supervised Pretext Task for Augmenting Few-Shot Learning

SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning

DBDC-SSL: Deep Brownian Distance Covariance With Self-Supervised Learning for Few-Shot Image Classification

Improving Few-Shot Learning with Auxiliary Self-Supervised Pretext Tasks

Few-Shot Image Classification via Contrastive Self-Supervised Learning

Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks

A Theory of Self-Supervised Framework for Few-Shot Learning

Task-Level Self-Supervision for Cross-Domain Few-Shot Learning

Unsupervised Few-Shot Feature Learning Via Self-Supervised Training

Self-supervised Knowledge Distillation for Few-shot Learning

Pareto Self-Supervised Training for Few-Shot Learning

Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

Reinforced Self-Supervised Training for Few-Shot Learning

Self-Supervised Tuning for Few-Shot Segmentation

ESPT: A Self-Supervised Episodic Spatial Pretext Task for Improving Few-Shot Learning

Improving In-Context Few-Shot Learning via Self-Supervised Training