Abstract:Few-shot object detection (FSOD) aims at learning a novel class object detector with abundant base class samples and a limited number of novel class samples. Some recent methods assume that base class images contain unlabeled novel class instances and mine these instances to address the data scarcity of novel classes. Despite achieving competitive results, these methods face two issues: First, mined instances are sampled around the provided few-shot instances, establishing biased data distributions to represent novel classes. Second, the rich novel class semantics contained in base class instances are largely ignored. Benefits from vision-language models (VLMs), we propose a VLM-guided Explicit-Implicit Complementary novel class semantic learning (VEIC) method for FSOD. VEIC incorporates a VLM-cooperated sample mining module that leverages the powerful semantic alignment capability of VLMs to mine representative unlabeled explicit novel instances. In addition, for implicit novel instances (ambiguous base instances contain novel class semantics), we employ a spatial-wise feature re-expression module to capture prominent novel class local patches. Then a dynamic class-transition label assign strategy is proposed to learn from implicit novel instances by utilizing deep network memorization, where implicit novel instances are regarded more as novel classes during the early training and later regarded more as base classes. Experimentally, learning novel class semantics from two complementary types of instances reaches the best performance. Furthermore, learning exclusively from implicit novel instances extends the pseudo-labeling method to a practical scenario where base class images do not contain unlabeled explicit novel instances.

Vlm-Guided Explicit-Implicit Complementary Novel Class Semantic Learning for Few-Shot Object Detection

Semantic Enhanced Few-shot Object Detection

Few-shot Weakly-Supervised Object Detection via Directional Statistics

Few-Shot Object Detection With Self-Supervising and Cooperative Classifier

Few-Shot Object Detection with Memory Contrastive Proposal Based on Semantic Priors

MINI: Mining Implicit Novel Instances for Few-Shot Object Detection

The Solution for CVPR2024 Foundational Few-Shot Object Detection Challenge

Identification of Novel Classes for Improving Few-Shot Object Detection

Fine-Grained Prototypes Distillation for Few-Shot Object Detection

PS-TTL: Prototype-based Soft-labels and Test-Time Learning for Few-shot Object Detection

Towards Generalized and Incremental Few-Shot Object Detection

Few-Shot Object Detection in Remote Sensing: Lifting the Curse of Incompletely Annotated Novel Objects

Multi-Faceted Distillation of Base-Novel Commonality for Few-shot Object Detection

Explicit Margin Equilibrium for Few-Shot Object Detection

SMILe: Leveraging Submodular Mutual Information For Robust Few-Shot Object Detection

ECEA: Extensible Co-Existing Attention for Few-Shot Object Detection

Few-shot Object Detection via Improved Classification Features

Revisiting Few-Shot Object Detection with Vision-Language Models

Few-Shot Object Detection in Unseen Domains

Generalized few-shot object detection in remote sensing images