Abstract:Despite significant success of deep learning in object detection tasks, the standard training of deep neural networks requires access to a substantial quantity of annotated images across all classes. Data annotation is an arduous and time-consuming endeavor, particularly when dealing with infrequent objects. Few-shot object detection (FSOD) methods have emerged as a solution to the limitations of classic object detection approaches based on deep learning. FSOD methods demonstrate remarkable performance by achieving robust object detection using a significantly smaller amount of training data. A challenge for FSOD is that instances from novel classes that do not belong to the fixed set of training classes appear in the background and the base model may pick them up as potential objects. These objects behave similarly to label noise because they are classified as one of the training dataset classes, leading to FSOD performance degradation. We develop a semi-supervised algorithm to detect and then utilize these unlabeled novel objects as positive samples during the FSOD training stage to improve FSOD performance. Specifically, we develop a hierarchical ternary classification region proposal network (HTRPN) to localize the potential unlabeled novel objects and assign them new objectness labels to distinguish these objects from the base training dataset classes. Our improved hierarchical sampling strategy for the region proposal network (RPN) also boosts the perception ability of the object detection model for large objects. We test our approach and COCO and PASCAL VOC baselines that are commonly used in FSOD literature. Our experimental results indicate that our method is effective and outperforms the existing state-of-the-art (SOTA) FSOD methods. Our implementation is provided as a supplement to support reproducibility of the results.

Generic Object Detection With Dense Neural Patterns and Regionlets

Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection

Rich Features and Precise Localization with Region Proposal Network for Object Detection.

C-RPNs: Promoting object detection in real world via a cascade structure of Region Proposal Networks.

Deep Learning for Generic Object Detection: A Survey

Generic object recognition with regional statistical models and layer joint boosting

HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection

Improving Object Detection with Region Similarity Learning

Deep Adaptive Proposal Network for Object Detection in Optical Remote Sensing Images

R-FCN: Object Detection via Region-based Fully Convolutional Networks

Object Detection via Aspect Ratio and Context Aware Region-based Convolutional Networks

C-FCN: Corners-based Fully Convolutional Network for Visual Object Detection

An Improved Approach for Object Proposals Generation

Learning Coarse-To-Fine Sparselets For Efficient Object Detection And Scene Classification

A Method for Detecting Objects in Dense Scenes

Fine-Grained Dynamic Head for Object Detection.

Feature Selective Networks for Object Detection

A New Method Based on Deep Convolutional Neural Networks for Object Detection and Classification

PV-RCNN++: Semantical Point-Voxel Feature Interaction for 3D Object Detection

Improved Region Proposal Network for Enhanced Few-Shot Object Detection

Keypoint Density-based Region Proposal for Fine-Grained Object Detection and Classification using Regions with Convolutional Neural Network Features