Abstract:Traditional methods for object detection typically necessitate a substantial amount of training data, and creating high-quality training data is time-consuming. We propose a novel Few-Shot Object Detection network (FSODv2) in this paper that aims to detect objects from previously unseen categories using only a few annotated examples. Attention RPN, Multi-Relation Detector, and Contrastive Training strategy are central to our method (Fan et al., in: CVPR, 2020), which exploit similarity between few shot support set and query set to detect novel objects while suppressing false detection in the background. We also contribute a new dataset, FSOD-1k, which contains 1000 categories of various objects with high-quality annotations to train our network. To the best of our knowledge, this is one of the first datasets designed for few-shot object detection. This paper improves our FSOD model through well-designed model calibration in three areas: (1) we propose an improved FPN with multi-scale support inputs to calibrate the multi-scale support-query feature matching by exploiting multi-scale features from the same support image with different input scales; (2) we introduce a support classification supervision branch to calibrate the support feature supervision, aligning to the query feature training supervision; (3) we propose backbone calibration to preserve prior knowledge while alleviating backbone bias toward base classes by employing classification dataset to help our model calibration procedure, where such dataset has previously only been used for pre-training in other related works. Besides, we propose a Fast Attention RPN to improve evaluation speed and save computational memory during inference. Once trained, our few-shot network can detect objects from previously unseen categories without further training or fine-tuning, resulting in new state-of-the-art performance on different datasets in the few-shot setting. Our method is general in scope and has numerous potential applications. The dataset link is https://github.com/fanq15/Few-Shot-Object-Detection-Dataset.

FewSOL: A Dataset for Few-Shot Object Learning in Robotic Environments

Few-shot Object Localization

Few-Shot Object Detection: A Comprehensive Survey

FewJoint: A Few-shot Learning Benchmark for Joint Language Understanding

Few-shot Learning for Domain-specific Fine-grained Image Classification

FewSAR: A Few-shot SAR Image Classification Benchmark

Few-Shot Object Detection With Attention-RPN and Multi-Relation Detector

Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving

When Few-Shot Learning Meets Video Object Detection

A Closer Look at Few-Shot Video Classification: A New Baseline and Benchmark

Lifelong Ensemble Learning based on Multiple Representations for Few-Shot Object Recognition

FewJoint: few-shot learning for joint dialogue understanding

Few-Shot Object Recognition from Machine-Labeled Web Images.

OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning

FSODv2: A Deep Calibrated Few-Shot Object Detection Network

A Few-shot-learning-based Method to Object Recognition in Multiple Scenarios.

Recent Advances of Few-Shot Learning Methods and Applications

A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities

Few-shot Learning for Multi-Modality Tasks