Abstract:Our research focuses on few-shot fine-grained image classification, which faces two major challenges: appearance similarity of fine-grained objects and limited number of samples. To preserve the appearance details of images, traditional feature reconstruction networks usually enhance the representation ability of key features by spatial feature reconstruction and minimizing the reconstruction error. However, we find that relying solely on a single type of feature is insufficient for accurately capturing inter-class differences of fine-grained objects in scenarios with limited samples. In contrast, the introduction of channel features provides additional information dimensions, aiding in better understanding and distinguishing the inter-class differences of fine-grained objects. Therefore, in this paper, we design a new Hybrid Feature Collaborative Reconstruction Network (HFCR-Net) for few-shot fine-grained image classification, which includes a Hybrid Feature Fusion Process (HFFP) and a Hybrid Feature Reconstruction Process (HFRP). In HFRP, we fuse the channel features and the spatial features. Through dynamic weight adjustment, we aggregate the spatial dependencies between arbitrary two positions and the correlations between different channels of each image to increase the inter-class differences. Additionally, we introduce the reconstruction of channel dimension in HFRP. Through the collaborative reconstruction of channel dimension and spatial dimension, the inter-class differences are further increased in the process of support-to-query reconstruction, while the intra-class differences are reduced in the process of query-to-support reconstruction. Ultimately, our extensive experiments on three widely used fine-grained datasets demonstrate the effectiveness and superiority of our approach.

Dual representations network for few-shot learning based on local descriptor importance: integrating global and local features

Multi-local feature relation network for few-shot learning

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

Unleash the Power of Local Representations for Few-Shot Classification

Dual-stream Multi-Modal Graph Neural Network for Few-Shot Learning

TALDS-Net: Task-Aware Adaptive Local Descriptors Selection for Few-shot Image Classification

LGSim: local task-invariant and global task-specific similarity for few-shot classification

Local Mutual Metric Network for Few-Shot Image Classification

A Simple Task-aware Contrastive Local Descriptor Selection Strategy for Few-shot Learning between inter class and intra class

In defense of local descriptor-based few-shot object detection

Local Feature Semantic Alignment Network for Few-Shot Image Classification

Local descriptor-based spatial cross attention network for few-shot learning

Learning Task-aware Local Representations for Few-shot Learning.

Representative local feature mining for few-shot learning

Feature fusion network based on few-shot fine-grained classification

BDLA: Bi-directional local alignment for few-shot learning

Saliency-Guided Mutual Learning Network for Few-shot Fine-grained Visual Recognition

Task-Aware Dual-Representation Network for Few-Shot Action Recognition

Local descriptor-based multi-prototype network for few-shot Learning

Hybrid Feature Collaborative Reconstruction Network for Few-Shot Fine-Grained Image Classification