Abstract:Few-shot object detection (FSOD) aims at designing models that can accurately detect targets of novel classes in a scarce data regime. Existing research has improved detection performance with meta-learning-based models. However, existing methods continue to exhibit certain imperfections: (1) Only the interacting global features of query and support images lead to ignoring local critical features in the imprecise localization of objects from new categories. (2) Convolutional neural networks (CNNs) encounter difficulty in learning diverse pose features from exceedingly limited labeled samples of unseen classes. (3) Local context information is not fully utilized in a global attention mechanism, which means the attention modules need to be improved. As a result, the detection performance of novel-class objects is compromised. To overcome these challenges, a few-shot object detection network is proposed with a local feature enhancement module and an intrinsic feature transformation module. In this paper, a local feature enhancement module (LFEM) is designed to raise the importance of intrinsic features of the novel-class samples. In addition, an Intrinsic Feature Transform Module (IFTM) is explored to enhance the feature representation of novel-class samples, which enriches the feature space of novel classes. Finally, a more effective cross-attention module, called Global Cross-Attention Network (GCAN), which fully aggregates local and global context information between query and support images, is proposed in this paper. The crucial features of novel-class objects are extracted effectively by our model before the feature fusion between query images and support images. Our proposed method increases, on average, the detection performance by 0.93 (nAP) in comparison with previous models on the PASCAL VOC FSOD benchmark dataset. Extensive experiments demonstrate the effectiveness of our modules under various experimental settings.

Cross Attention with Deep Local Features for Few-Shot Image Classification

Local descriptor-based spatial cross attention network for few-shot learning

Cross Attention Network for Few-shot Classification

Few-Shot Object Detection with Local Feature Enhancement and Feature Interrelation

Few-Shot Learning Based on Deep Learning for Image Classification

Reasearch on Cross Domain Few-shot Learning Method Based on Local Feature Association

Channel-Spatial Support-Query Cross-Attention for Fine-Grained Few-Shot Image Classification

TALDS-Net: Task-Aware Adaptive Local Descriptors Selection for Few-shot Image Classification

Local feature graph neural network for few-shot learning

Local Spatial Alignment Network for Few-Shot Learning

Few-Shot Learning Via Task-Aware Discriminant Local Descriptors Network

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

Adaptive Local Feature Matching for Few-shot Fine-grained Image Recognition

A Simple Task-aware Contrastive Local Descriptor Selection Strategy for Few-shot Learning between inter class and intra class

Looking Wider for Better Adaptive Representation in Few-Shot Learning

Multi-scale Feature Modification Network for FewShot Image Classification

LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning

Few-Shot Image Classification Based on Asymmetric Convolution and Attention Mechanism

Adaptive Feature Representation Based on Contrastive Learning for Few-Shot Classification

Attention-Based Contrastive Learning for Few-Shot Remote Sensing Image Classification