Abstract:Few-shot image classification remains a persistent challenge due to the intrinsic difficulty faced by visual recognition models in achieving generalization with limited training data. Existing methods primarily focus on exploiting marginal distributions and overlook the disparity between the product of marginals and the joint characteristic functions. This can lead to less robust feature representations. In this paper, we introduce DBDC-SSL, a method that aims to improve few-shot visual recognition models by learning a feature extractor that produces image representations that are more robust. To improve the robustness of the model, we integrate DeepBDC (DBDC) during the training process to learn better feature embeddings by effectively computing the disparity between product of the marginals and joint characteristic functions of the features. To reduce overfitting and improve the generalization of the model, we utilize an auxiliary rotation loss for self-supervised learning (SSL) in the training of the feature extractor. The auxiliary rotation loss is derived from a pretext task, where input images undergo rotation by predefined angles, and the model classifies the rotation angle based on the features it generates. Experimental results demonstrate that DBDC-SSL is able to outperform current state-of-the-art methods on 4 common few-shot image classification benchmark, which are miniImageNet, tieredImageNet, CUB and CIFAR-FS. For 5-way 1-shot and 5-way 5-shot tasks respectively, the proposed DBDC-SSL achieved the accuracy of 68.64±0.43 and 86.02±0.28 on miniImageNet, 73.88±0.48 and 89.03±0.29 on tieredImageNet, 84.67±0.39 and 94.76±0.16 on CUB, and 75.60±0.44 and 88.49±0.31 on CIFAR-FS.

DeepEMD: Few-Shot Image Classification With Differentiable Earth Mover’s Distance and Structured Classifiers

DeepEMD: Differentiable Earth Mover's Distance for Few-Shot Learning

Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification

Few-Shot Scene Classification With Multi-Attention Deepemd Network In Remote Sensing

Multi-attention DeepEMD for Few-Shot Learning in Remote Sensing

DBDC-SSL: Deep Brownian Distance Covariance With Self-Supervised Learning for Few-Shot Image Classification

Few-Shot Learning Based on Deep Learning for Image Classification

Deep Metric Learning for Few-Shot Image Classification: A Review of Recent Developments

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

Few-Shot Image Classification Based on Swin Transformer + CSAM + EMD

A Two-Stream Network with Image-to-Class Deep Metric for Few-Shot Classification.

Learning to focus: cascaded feature matching network for few-shot image recognition

Explicit Margin Equilibrium for Few-Shot Object Detection

BDLA: Bi-directional local alignment for few-shot learning

DCPNet: Distribution Calibration Prototypical Network for Few-Shot Image Classification

Multi-distance Metric Network for Few-Shot Learning

Bilaterally Normalized Scale-Consistent Sinkhorn Distance for Few-Shot Image Classification

Disentangled Feature Representation for Few-shot Image Classification

Enlarge the Hidden Distance: A More Distinctive Embedding to Tell Apart Unknowns for Few-Shot Learning.

Reasearch on Cross Domain Few-shot Learning Method Based on Local Feature Association