Abstract:Self-supervision learning (SSL) has shown exceptionally promising results in natural language processing and, more recently, in image classification and recognition. Recent research works have demonstrated SSL's benefits on large unlabeled datasets. However, relatively little investigation has been done into how well it works with smaller datasets. Typically, this challenge entails training a model on a very small quantity of data and then evaluating the model on out-of-distribution data. Few-shot image classification aims to classify classes that haven't been seen before using a limited number of training examples. Recent few-shot learning research focuses on developing good representation models that can quickly adapt to test tasks. In this paper, we investigate the role of self-supervision in the context of few-shot learning. We devised a model that improves the network's representation learning by employing a self-supervised auxiliary task that is based on composite rotation. We propose a composite rotation-based auxiliary task that rotates the image on two levels: inner and outer, and assigns one of 16 rotation classes to the modified image. Then, we further trained our model, which enables us to capture the robust learnable features that assist in focusing on better visual details of an object present in the given image. We find that the network is able to learn to extract more generalized and discriminative features, which in turn helps to enhance the effectiveness of its few-shot classification. This approach significantly outperforms the state-of-the-art on several public benchmarks. In addition, we demonstrated empirically that models trained using the proposed approach perform better than the baseline model even when the query examples in the episode are not aligned with the support examples. Extensive ablation experiments are performed to validate the various components of our approach. We also investigate our strategy's impact on the network's ability to discriminate visual features.

A Theory of Self-Supervised Framework for Few-Shot Learning

Self-Supervision Can Be a Good Few-Shot Learner

Pareto Self-Supervised Training for Few-Shot Learning

When Does Self-supervision Improve Few-Shot Learning?

SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning

How Well Do Self-Supervised Methods Perform in Cross-Domain Few-Shot Learning?

SSL-DC: Improving Transductive Few-Shot Learning Via Self-Supervised Learning and Distribution Calibration.

Learning to Self-Train for Semi-Supervised Few-Shot Classification.

Rethinking Self-Supervision for Few-Shot Class-Incremental Learning

Self-Supervison with data-augmentation improves few-shot learning

Reinforced Self-Supervised Training for Few-Shot Learning

Boosting Supervision with Self-Supervision for Few-shot Learning

Unsupervised Few-Shot Feature Learning Via Self-Supervised Training

Local Spatial Alignment Network for Few-Shot Learning

Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

Three-Dimension Attention Mechanism and Self-Supervised Pretext Task for Augmenting Few-Shot Learning

Few-Shot Classification with Multi-task Self-supervised Learning.

Generalizing from a Few Examples: A Survey on Few-Shot Learning

Few-Shot Image Classification via Contrastive Self-Supervised Learning

Cross-domain self-supervised few-shot learning via multiple crops with teacher-student network

Semi-Supervised Learning in the Few-Shot Zero-Shot Scenario