Abstract:Few-shot object detection (FSOD) aims at learning a novel class object detector with abundant base class samples and a limited number of novel class samples. Some recent methods assume that base class images contain unlabeled novel class instances and mine these instances to address the data scarcity of novel classes. Despite achieving competitive results, these methods face two issues: First, mined instances are sampled around the provided few-shot instances, establishing biased data distributions to represent novel classes. Second, the rich novel class semantics contained in base class instances are largely ignored. Benefits from vision-language models (VLMs), we propose a VLM-guided Explicit-Implicit Complementary novel class semantic learning (VEIC) method for FSOD. VEIC incorporates a VLM-cooperated sample mining module that leverages the powerful semantic alignment capability of VLMs to mine representative unlabeled explicit novel instances. In addition, for implicit novel instances (ambiguous base instances contain novel class semantics), we employ a spatial-wise feature re-expression module to capture prominent novel class local patches. Then a dynamic class-transition label assign strategy is proposed to learn from implicit novel instances by utilizing deep network memorization, where implicit novel instances are regarded more as novel classes during the early training and later regarded more as base classes. Experimentally, learning novel class semantics from two complementary types of instances reaches the best performance. Furthermore, learning exclusively from implicit novel instances extends the pseudo-labeling method to a practical scenario where base class images do not contain unlabeled explicit novel instances.

Pseudo-label Diversity Exploitation for Few-Shot Object Detection.

Few-shot Weakly-Supervised Object Detection via Directional Statistics

PS-TTL: Prototype-based Soft-labels and Test-Time Learning for Few-shot Object Detection

Semantic Enhanced Few-shot Object Detection

Few-Shot Object Detection in Remote Sensing: Lifting the Curse of Incompletely Annotated Novel Objects

Few-Shot Object Detection With Self-Supervising and Cooperative Classifier

Fine-Grained Prototypes Distillation for Few-Shot Object Detection

Generalized few-shot object detection in remote sensing images

Few-Shot Object Detection in Remote-Sensing Images via Label-Consistent Classifier and Gradual Regression

Label, Verify, Correct: A Simple Few Shot Object Detection Method

FSNA: Few-Shot Object Detection via Neighborhood Information Adaption and All Attention

Few-Shot Object Detection in Unseen Domains

ECEA: Extensible Co-Existing Attention for Few-Shot Object Detection

Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation

Exploiting Low-confidence Pseudo-labels for Source-free Object Detection

TIDE: Test-Time Few-Shot Object Detection

Few-Shot Object Detection: Research Advances and Challenges

Understanding Negative Proposals in Generic Few-Shot Object Detection

Vlm-Guided Explicit-Implicit Complementary Novel Class Semantic Learning for Few-Shot Object Detection

Few-shot Object Detection via Improved Classification Features