Abstract:Learning novel classes with a few samples per class is a very challenging task in deep learning. To mitigate this issue, previous studies have utilized an additional dataset with extensively labeled samples to realize transfer learning. Alternatively, many studies have used unlabeled samples that originated from the novel dataset to achieve few-shot learning, i.e., semi-supervised few-shot learning. In this paper, an easy but efficient semi-supervised few-shot learning model is proposed to address the embeddings mismatch problem that results from inconsistent data distributions between the novel and base datasets, where samples with the same label approach each other while samples with different labels separate from each other in the feature space. This model emphasizes pseudo-labeling guided contrastive learning. We also develop a novel local factor clustering module to improve the ability to obtain pseudo-labels from unlabeled samples, and this module fuses the local feature information of labeled and unlabeled samples. We report our experimental results on the mini-ImageNet and tiered-ImageNet datasets for both five-way one-shot and five-way five-shot settings and achieve better performance than previous models. In particular, the classification accuracy of our model is improved by approximately 11.53% and 14.87% compared to the most advanced semi-supervised few-shot learning model we know in the five-way one-shot scenario. Moreover, ablation experiments in this paper show that our proposed clustering strategy demonstrates accuracy improvements of about 4.00% in the five-way one-shot and five-way five-shot scenarios compared to two popular clustering methods.

Efficient Few-Shot Classification Via Contrastive Pretraining on Web Data.

Feature Transformation for Few-Shot Learning

Improving Few-shot Text Classification via Pretrained Language Representations

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks

SPContrastNet: A Self-Paced Contrastive Learning Model for Few-Shot Text Classification

Few-Shot Image Classification via Contrastive Self-Supervised Learning

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classification

FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models?

Supervised Contrastive Representation Embedding Based on Transformer for Few-Shot Classification

Few-Shot Classification with Contrastive Learning

Boosting Few-Shot Classification with View-Learnable Contrastive Learning

A Contrastive Model with Local Factor Clustering for Semi-Supervised Few-Shot Learning

A Comparative Study of Contrastive Learning-Based Few-Shot Unsupervised Algorithms for Efficient Deep Learning

Superclass-aware network for few-shot learning

SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning

Attention-Based Contrastive Learning for Few-Shot Remote Sensing Image Classification

Less is More: A Closer Look at Semantic-based Few-Shot Learning

Training Few-Shot Classification via the Perspective of Minibatch and Pretraining

Three-Dimension Attention Mechanism and Self-Supervised Pretext Task for Augmenting Few-Shot Learning

Cross Attention Network for Few-shot Classification