Abstract:<p>Small object detection is a highly challenging problem due to the limited resolution and information of small objects. Current state-of-the-art detectors only utilize the appearance feature to locate and classify objects. However, such detectors are prone to failure when detecting small objects, especially in the case of heavy appearance changes and background distractors, in which the appearance feature alone is not sufficient for robust detection. Exploiting context information in the surrounding scene can be highly beneficial in such cases. In this paper, we propose a novel detector, the Internal-External Network (IENet), which uses both the appearance and context information of the object for robust detection. In the proposed approach, small object detection is improved from feature extraction, proposal location, and classification. Specifically, three customized modules are designed, including the Bidirectional Feature Fusion Module (Bi-FFM), Context Reasoning Module (CRM), and Context Feature Augmentation Module (CFAM). Bi-FFM is designed to capture the internal feature of objects by transferring the semantic feature of deeper-level layers to lower-level layers and the detailed feature of lower-level layers to deeper-level layers in neural networks. The proposed approach not only utilizes the hierarchy of convolutional features but also improves its prediction via context relationships. CRM is designed to improve the quality of region proposals by context reasoning that uses easily detected objects to help understand hard ones. Furthermore, CFAM is designed to learn pair-wise relations between region proposals produced by CRM, and such relations are used to produce global feature information associated with the region proposals for accurate classification. Extensive experiments are conducted on the challenging COCO and WIDER FACE datasets to demonstrate the effectiveness of the proposed approach. Experimental results show that the detection performance of small objects is greatly improved over state-of-the-art detectors.</p>

Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks

Inside-outside net: Detecting objects in context with skip pooling and recurrent neural networks

Supplemental Material: Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks

Efficient Selective Context Network for Accurate Object Detection

Object Detection Based on Faster R-CNN Algorithm with Skip Pooling and Fusion of Contextual Information

Multi-scale Global Context Feature Pyramid Network for Object Detector

Multi-scale Context Enhancement Network for Object Detection

Realize your surroundings: Exploiting context information for small object detection

Tiny-RetinaNet: A One-Stage Detector for Real-Time Object Detection

Multi-scale Feature and Spatial Relation Inference for Object Detection.

RON: Reverse Connection with Objectness Prior Networks for Object Detection

Object Detector with Enriched Global Context Information

Attentive Contexts for Object Detection

OCNet: Object Context Network for Scene Parsing

SFGNet Detecting Objects Via Spatial Fine-Grained Feature and Enhanced RPN with Spatial Context

Putting visual object recognition in context

Auto-Context R-CNN

Object Detection Algorithm Based on Context Information and Self-Attention Mechanism

Object Detection via Aspect Ratio and Context Aware Region-based Convolutional Networks

Learning to zoom: Exploiting mixed-scale contextual information for object detection

YOLOv8-CGRNet: A Lightweight Object Detection Network Leveraging Context Guidance and Deep Residual Learning