Abstract:Few-shot fine-grained recognition (FS-FGR) aims to recognize novel fine-grained categories with the help of limited available samples. Undoubtedly, this task inherits the main challenges from both few-shot learning and fine-grained recognition. First, the lack of labeled samples makes the learned model easy to overfit. Second, it also suffers from high intra-class variance and low inter-class differences in the datasets. To address this challenging task, we propose a two-stage background suppression and foreground alignment framework, which is composed of a background activation suppression (BAS) module, a foreground object alignment (FOA) module, and a local-to-local (L2L) similarity metric. Specifically, the BAS is introduced to generate a foreground mask for localization to weaken back-ground disturbance and enhance dominative foreground objects. The FOA then reconstructs the feature map of each support sample according to its correction to the query ones, which addresses the problem of misalignment between support-query image pairs. To enable the proposed method to have the ability to capture subtle differences in confused samples, we present a novel L2L similarity metric to further measure the local similarity between a pair of aligned spatial features in the embedding space. What’s more, considering that background interference brings poor robustness, we infer the pairwise similarity of feature maps using both the raw image and the refined image. Extensive experiments conducted on multiple popular fine-grained benchmarks demonstrate that our method outperforms the existing state of the art by a large margin. The source codes are available at: https://github.com/CSer-Tang-hao/BSFA-FSFG.

Adaptive Local Feature Matching for Few-shot Fine-grained Image Recognition

Local Spatial Alignment Network for Few-Shot Learning

Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification

Learning Task-aware Local Representations for Few-shot Learning.

Learning to focus: cascaded feature matching network for few-shot image recognition

Representative local feature mining for few-shot learning

TALDS-Net: Task-Aware Adaptive Local Descriptors Selection for Few-shot Image Classification

Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning

Local Feature Semantic Alignment Network for Few-Shot Image Classification

A Simple Task-aware Contrastive Local Descriptor Selection Strategy for Few-shot Learning between inter class and intra class

Attentive fine-grained recognition for cross-domain few-shot classification

Imposing Semantic Consistency of Local Descriptors for Few-Shot Learning

Feature Aligning Few shot Learning Method Using Local Descriptors Weighted Rules

Local descriptor-based spatial cross attention network for few-shot learning

DLA-MatchNet for Few-Shot Remote Sensing Image Scene Classification

LGSim: local task-invariant and global task-specific similarity for few-shot classification

Task Adaptive Feature Distribution Based Network for Few-shot Fine-grained Target Classification

Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment