Abstract:Few-shot-learning (FSL) commonly requires a model to identify images (queries) that belong to classes unseen during training, based on a few labeled samples of the new classes (support set) as reference. So far, plenty of algorithms involve training data augmentation to improve the generalization capability of FSL models, but outlier queries or support images during inference can still pose great generalization challenges. In this work, to reduce the bias caused by the outlier samples, we generate additional test-class samples by combining original samples with suitable train-class samples via a generative image combiner. Then, we obtain averaged features via an augmentor, which leads to more typical representations through the averaging. We experimentally and theoretically demonstrate the effectiveness of our method, e.g., obtaining a test accuracy improvement proportion of around 10% (e.g., from 46.86% to 53.28%) for trained FSL models. Importantly, given pretrained image combiner, our method is training-free for off-the-shelf FSL models, whose performance can be improved without extra datasets nor further training of the models themselves.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the issue of outliers in Few-Shot Learning (FSL). In FSL, models typically need to recognize images of unseen categories (queries) based on a small number of labeled samples (support set). Although many algorithms improve the generalization ability of FSL models through training data augmentation, outlier queries or support images still pose significant challenges to the model's generalization performance during inference. Specifically, the paper proposes a new method—FSL-Rectifier, which reduces the impact of outliers through Test-Time Augmentation. FSL-Rectifier generates additional test category samples and averages the features of these samples to obtain more typical representations. Experimental results show that this method can significantly improve the test accuracy of FSL models, for example, from 46.86% to 53.28%. ### Method Overview 1. **Image Combiner**: Utilizes the Generative Adversarial Network (GAN) mechanism to combine the shape of one image (such as the posture and eye position of an animal) with the style of another image (such as the defining features of the animal's category) to generate new test category samples. 2. **Neighbour Selector**: During testing, selects an appropriate training sample to combine with the test sample to generate new test samples. The selection criteria are based on the evaluation of generation quality. 3. **Augmentor**: Averages the features of the original test samples and the generated test samples to reduce the impact of outliers. ### Main Contributions - Proposes a new test-time augmentation pipeline, including an Image Combiner, Neighbour Selector, and Augmentor. - Validates the effectiveness of the method through experiments, achieving approximately a 4% performance improvement on an animal face dataset. - Theoretically analyzes the potential of the method in reducing the generalization error of FSL models. ### Experimental Results Experimental results show that FSL-Rectifier can significantly improve performance across multiple FSL models, especially in handling outliers. Compared to existing test-time augmentation techniques, the improvement of FSL-Rectifier is more pronounced. ### Further Discussion - **Proximity to Category Center and Norm Reduction**: Through feature averaging, the test sample features are closer to the category center, reducing the impact of outliers. Experimental results also confirm this. - **Importance of Neighbour Selector**: The Neighbour Selector plays a key role in generating high-quality samples, with reverse selectors and random selectors performing worse than the original method. - **Skipping Augmentation**: To prevent potential generation failures, a skipping mechanism is proposed, along with two different skipping methods. In summary, this paper effectively addresses the outlier problem in FSL through test-time augmentation, improving the model's generalization ability and accuracy.

FSL-Rectifier: Rectify Outliers in Few-Shot Learning via Test-Time Augmentation

PatchMix Augmentation to Identify Causal Features in Few-shot Learning

Multi‐task Few‐shot Learning with Composed Data Augmentation for Image Classification

Feature Transformation for Few-Shot Learning

Boosting Generalized Few-Shot Learning by Scattering Intra-class Distribution

Hybrid Consistency Training with Prototype Adaptation for Few-Shot Learning

How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation

Feature Augmentation Based on Information Fusion Rectification for Few-Shot Image Classification

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

Boosting Few-Shot Learning via Attentive Feature Regularization

FADS: Fourier-Augmentation based Data-Shunting for Few-Shot Classification

Fine-Grained Few Shot Learning with Foreground Object Transformation

Adaptive Attribute Distribution Similarity for Few-Shot Learning

Few-Shot Learning With Enhancements to Data Augmentation and Feature Extraction

Boosting Few-Shot Learning with Adaptive Margin Loss

Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning

Feature Mixture on Pre-Trained Model for Few-Shot Learning

Adversarial Feature Hallucination Networks for Few-Shot Learning

Counterfactual Generation Framework for Few-Shot Learning

Revisit Finetuning strategy for Few-Shot Learning to Strengthen the Equivariance of Emdeddings