Abstract:Few-shot image classification remains a persistent challenge due to the intrinsic difficulty faced by visual recognition models in achieving generalization with limited training data. Existing methods primarily focus on exploiting marginal distributions and overlook the disparity between the product of marginals and the joint characteristic functions. This can lead to less robust feature representations. In this paper, we introduce DBDC-SSL, a method that aims to improve few-shot visual recognition models by learning a feature extractor that produces image representations that are more robust. To improve the robustness of the model, we integrate DeepBDC (DBDC) during the training process to learn better feature embeddings by effectively computing the disparity between product of the marginals and joint characteristic functions of the features. To reduce overfitting and improve the generalization of the model, we utilize an auxiliary rotation loss for self-supervised learning (SSL) in the training of the feature extractor. The auxiliary rotation loss is derived from a pretext task, where input images undergo rotation by predefined angles, and the model classifies the rotation angle based on the features it generates. Experimental results demonstrate that DBDC-SSL is able to outperform current state-of-the-art methods on 4 common few-shot image classification benchmark, which are miniImageNet, tieredImageNet, CUB and CIFAR-FS. For 5-way 1-shot and 5-way 5-shot tasks respectively, the proposed DBDC-SSL achieved the accuracy of 68.64±0.43 and 86.02±0.28 on miniImageNet, 73.88±0.48 and 89.03±0.29 on tieredImageNet, 84.67±0.39 and 94.76±0.16 on CUB, and 75.60±0.44 and 88.49±0.31 on CIFAR-FS.

Feature Distribution Fitting with Direction-Driven Weighting for Few-Shot Images Classification.

Feature Transformation for Few-Shot Learning

Reweighting and Information-Guidance Networks for Few-Shot Learning

Adaptive Weights and Sample's Distribution for Few Shot Classification.

Adaptive Attribute Distribution Similarity for Few-Shot Learning

Learning multi-level weight-centric features for few-shot learning

Transductive Distribution Calibration for Few-Shot Learning

Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification

Discriminative Few-Shot Learning Based on Directional Statistics

Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal Transport

Task Encoding with Distribution Calibration for Few-Shot Learning

Dual Branch Relation Network with Feature Weighting for Few-Shot Learning

Mixture Distribution Graph Network for Few Shot Learning

Feature Rectification and Distribution Correction for Few-Shot Image Classification

Autonomous Perception and Adaptive Standardization for Few-Shot Learning

Few-Shot Learning With Enhancements to Data Augmentation and Feature Extraction

Feature Transformation Network for Few-Shot Learning

DBDC-SSL: Deep Brownian Distance Covariance With Self-Supervised Learning for Few-Shot Image Classification

ML-FDA: Meta-Learning via Feature Distribution Alignment for Few-Shot Learning

Learning more discriminative local descriptors with parameter-free weighted attention for few-shot learning

Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning