Abstract:Few-shot object detection (FSOD) aims at designing models that can accurately detect targets of novel classes in a scarce data regime. Existing research has improved detection performance with meta-learning-based models. However, existing methods continue to exhibit certain imperfections: (1) Only the interacting global features of query and support images lead to ignoring local critical features in the imprecise localization of objects from new categories. (2) Convolutional neural networks (CNNs) encounter difficulty in learning diverse pose features from exceedingly limited labeled samples of unseen classes. (3) Local context information is not fully utilized in a global attention mechanism, which means the attention modules need to be improved. As a result, the detection performance of novel-class objects is compromised. To overcome these challenges, a few-shot object detection network is proposed with a local feature enhancement module and an intrinsic feature transformation module. In this paper, a local feature enhancement module (LFEM) is designed to raise the importance of intrinsic features of the novel-class samples. In addition, an Intrinsic Feature Transform Module (IFTM) is explored to enhance the feature representation of novel-class samples, which enriches the feature space of novel classes. Finally, a more effective cross-attention module, called Global Cross-Attention Network (GCAN), which fully aggregates local and global context information between query and support images, is proposed in this paper. The crucial features of novel-class objects are extracted effectively by our model before the feature fusion between query images and support images. Our proposed method increases, on average, the detection performance by 0.93 (nAP) in comparison with previous models on the PASCAL VOC FSOD benchmark dataset. Extensive experiments demonstrate the effectiveness of our modules under various experimental settings.

Information Extraction Enhancement for Few-Shot Object Detection in Remote Sensing Images

Few-Shot Object Detection in Remote Sensing Imagery Via Fuse Context Dependencies and Global Features

Few-Shot Object Detection Via Context-Aware Aggregation for Remote Sensing Images.

Few-Shot Object Detection with Local Feature Enhancement and Feature Interrelation

Few-Shot Object Detection on Remote Sensing Images Based on Diverse Regional Feature Generation

Transformer-Based Few-Shot Object Detection with Multi-Relation Matching for Remote Sensing Images

Few-shot Object Detection with Feature Attention Highlight Module in Remote Sensing Images

Context-Transformer: Tackling Object Confusion for Few-Shot Detection

Few-Shot Object Detection on Remote Sensing Images via Shared Attention Module and Balanced Fine-Tuning Strategy

Few-Shot Object Detection for Remote Sensing Imagery Using Segmentation Assistance and Triplet Head

Text Semantic Fusion Relation Graph Reasoning for Few-Shot Object Detection on Remote Sensing Images

Few-Shot Object Detection with Multi-level Information Interaction for Optical Remote Sensing Images

InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images

Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning

Non-Local Proposal Dynamic Enhancement Learning for Few-Shot Object Detection in Remote Sensing Images.

Few-Shot Object Detection in Remote Sensing Image Interpretation: Opportunities and Challenges

Few-Shot Object Detection with Sparse Context Transformers

Few‐shot object detection based on global context and implicit knowledge decoupled head

Multi-scale Self-attention-based Few-shot Object Detection for Remote Sensing Images.

Multi-Modal Prototypes for Few-Shot Object Detection in Remote Sensing Images

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks