Abstract:Despite significant success of deep learning in object detection tasks, the standard training of deep neural networks requires access to a substantial quantity of annotated images across all classes. Data annotation is an arduous and time-consuming endeavor, particularly when dealing with infrequent objects. Few-shot object detection (FSOD) methods have emerged as a solution to the limitations of classic object detection approaches based on deep learning. FSOD methods demonstrate remarkable performance by achieving robust object detection using a significantly smaller amount of training data. A challenge for FSOD is that instances from novel classes that do not belong to the fixed set of training classes appear in the background and the base model may pick them up as potential objects. These objects behave similarly to label noise because they are classified as one of the training dataset classes, leading to FSOD performance degradation. We develop a semi-supervised algorithm to detect and then utilize these unlabeled novel objects as positive samples during the FSOD training stage to improve FSOD performance. Specifically, we develop a hierarchical ternary classification region proposal network (HTRPN) to localize the potential unlabeled novel objects and assign them new objectness labels to distinguish these objects from the base training dataset classes. Our improved hierarchical sampling strategy for the region proposal network (RPN) also boosts the perception ability of the object detection model for large objects. We test our approach and COCO and PASCAL VOC baselines that are commonly used in FSOD literature. Our experimental results indicate that our method is effective and outperforms the existing state-of-the-art (SOTA) FSOD methods. Our implementation is provided as a supplement to support reproducibility of the results.

Hierarchical objectness network for region proposal generation and object detection.

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Hierarchical Region Proposal Refinement Network for Weakly Supervised Object Detection

Boundary Objectness Network For Object Detection And Localization

Interactive Hierarchical Object Proposals

Improved Region Proposal Network for Enhanced Few-Shot Object Detection

Toward Scale-Invariance and Position-Sensitive Region Proposal Networks

Object Detection based on Cortex Hierarchical Activation in Border Sensitive Mechanism and Classification-GIoU Joint Representation

Hierarchical object representations for visual recognition via weakly supervised learning

Hierarchical Object Detection with Deep Reinforcement Learning

Hierarchical Context Embedding for Region-based Object Detection.

Hierarchical Reasoning Network for Human-Object Interaction Detection

A Hierarchical Graph Network for 3D Object Detection on Point Clouds

Scale-aware Pixel-wise Object Proposal Networks

RFP-Net: Receptive field-based proposal generation network for object detection

Concise Feature Pyramid Region Proposal Network for Multi-Scale Object Detection.

Pyramid Sub-Region Sensitive Network for Object Detection.

Hierarchical and Interactive Refinement Network for Edge-Preserving Salient Object Detection