Abstract:<p>Small object detection is a highly challenging problem due to the limited resolution and information of small objects. Current state-of-the-art detectors only utilize the appearance feature to locate and classify objects. However, such detectors are prone to failure when detecting small objects, especially in the case of heavy appearance changes and background distractors, in which the appearance feature alone is not sufficient for robust detection. Exploiting context information in the surrounding scene can be highly beneficial in such cases. In this paper, we propose a novel detector, the Internal-External Network (IENet), which uses both the appearance and context information of the object for robust detection. In the proposed approach, small object detection is improved from feature extraction, proposal location, and classification. Specifically, three customized modules are designed, including the Bidirectional Feature Fusion Module (Bi-FFM), Context Reasoning Module (CRM), and Context Feature Augmentation Module (CFAM). Bi-FFM is designed to capture the internal feature of objects by transferring the semantic feature of deeper-level layers to lower-level layers and the detailed feature of lower-level layers to deeper-level layers in neural networks. The proposed approach not only utilizes the hierarchy of convolutional features but also improves its prediction via context relationships. CRM is designed to improve the quality of region proposals by context reasoning that uses easily detected objects to help understand hard ones. Furthermore, CFAM is designed to learn pair-wise relations between region proposals produced by CRM, and such relations are used to produce global feature information associated with the region proposals for accurate classification. Extensive experiments are conducted on the challenging COCO and WIDER FACE datasets to demonstrate the effectiveness of the proposed approach. Experimental results show that the detection performance of small objects is greatly improved over state-of-the-art detectors.</p>

Small Object Detection Using Context Information Fusion in Faster R-CNN

$\mathcal{R}^2$ -CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images

Object Detection Based on Faster R-CNN Algorithm with Skip Pooling and Fusion of Contextual Information

An Improved Faster R-CNN for Small Object Detection

A Small Object Detection Algorithm Based on Improved Faster RCNN

Contextual Information Fusion for Small Object Detection

Realize your surroundings: Exploiting context information for small object detection

Small Object Detection with Improved CenterNet

Dynamic Feature and Context Enhancement Network for Faster Detection of Small Objects

Improving small object detection via context-aware and feature-enhanced plug-and-play modules

Tiny object detection with context enhancement and feature purification

Traffic Sign Detection using Feature Fusion and Contextual Information

Improved YOLOv5 Network with Attention and Context for Small Object Detection

Object Detection Algorithm Based on Context Information and Self-Attention Mechanism

Exploring Context Information for Accurate and Fast Object Detection

Feature Rescaling and Fusion for Tiny Object Detection

CA2Det: Cascaded Adaptive Fusion Pyramid Network Based on Attention Mechanism for Small Object Detection

Efficient Selective Context Network for Accurate Object Detection

Small Object Detection Method Based on Adaptive Spatial Parallel Convolution and Fast Multi-Scale Fusion

Small Object Detection using Multi-scale Feature Fusion and Attention

Small Object Detection in Optical Remote Sensing Images Via Modified Faster R-CNN