Abstract:In Few-Shot Learning (FSL), the objective is to correctly recognize new samples from novel classes with only a few available samples per class. Existing methods in FSL primarily focus on learning transferable knowledge from base classes by maximizing the information between feature representations and their corresponding labels. However, this approach may suffer from the "supervision collapse" issue, which arises due to a bias towards the base classes. In this paper, we propose a solution to address this issue by preserving the intrinsic structure of the data and enabling the learning of a generalized model for the novel classes. Following the InfoMax principle, our approach maximizes two types of mutual information (MI): between the samples and their feature representations, and between the feature representations and their class labels. This allows us to strike a balance between discrimination (capturing class-specific information) and generalization (capturing common characteristics across different classes) in the feature representations. To achieve this, we adopt a unified framework that perturbs the feature embedding space using two low-bias estimators. The first estimator maximizes the MI between a pair of intra-class samples, while the second estimator maximizes the MI between a sample and its augmented views. This framework effectively combines knowledge distillation between class-wise pairs and enlarges the diversity in feature representations. By conducting extensive experiments on popular FSL benchmarks, our proposed approach achieves comparable performances with state-of-the-art competitors. For example, we achieved an accuracy of 69.53% on the miniImageNet dataset and 77.06% on the CIFAR-FS dataset for the 5-way 1-shot task.

Efficient Feature Reconstruction Via L2,1-Norm Regularization for Few-Shot Classification

Feature Transformation for Few-Shot Learning

Self-reconstruction network for fine-grained few-shot classification

Locally-Enriched Cross-Reconstruction for Few-Shot Fine-Grained Image Classification

A conditioned feature reconstruction network for few-shot classification

Attribute- and attention-guided few-shot classification

Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

Bi-directional Feature Reconstruction Network for Fine-Grained Few-Shot Image Classification.

Autonomous Perception and Adaptive Standardization for Few-Shot Learning

Bilaterally Normalized Scale-Consistent Sinkhorn Distance for Few-Shot Image Classification

Multi-scale Feature Modification Network for FewShot Image Classification

Feature Reconstruction and Metric Based Network for Few-Shot Object Detection

Few-Shot Learning With Enhancements to Data Augmentation and Feature Extraction

Class Feature Sub-space for Few-Shot Classification

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

Feature Transformation Network for Few-Shot Learning

A Novel Method of Data and Feature Enhancement for Few-Shot Image Classification.

Unleash the Power of Local Representations for Few-Shot Classification

Unsupervised Few-Shot Image Classification by Learning Features into Clustering Space

Cross Attention Network for Few-shot Classification

Feature Learning for One-Shot Face Recognition.