Abstract:<p>Small object detection is a highly challenging problem due to the limited resolution and information of small objects. Current state-of-the-art detectors only utilize the appearance feature to locate and classify objects. However, such detectors are prone to failure when detecting small objects, especially in the case of heavy appearance changes and background distractors, in which the appearance feature alone is not sufficient for robust detection. Exploiting context information in the surrounding scene can be highly beneficial in such cases. In this paper, we propose a novel detector, the Internal-External Network (IENet), which uses both the appearance and context information of the object for robust detection. In the proposed approach, small object detection is improved from feature extraction, proposal location, and classification. Specifically, three customized modules are designed, including the Bidirectional Feature Fusion Module (Bi-FFM), Context Reasoning Module (CRM), and Context Feature Augmentation Module (CFAM). Bi-FFM is designed to capture the internal feature of objects by transferring the semantic feature of deeper-level layers to lower-level layers and the detailed feature of lower-level layers to deeper-level layers in neural networks. The proposed approach not only utilizes the hierarchy of convolutional features but also improves its prediction via context relationships. CRM is designed to improve the quality of region proposals by context reasoning that uses easily detected objects to help understand hard ones. Furthermore, CFAM is designed to learn pair-wise relations between region proposals produced by CRM, and such relations are used to produce global feature information associated with the region proposals for accurate classification. Extensive experiments are conducted on the challenging COCO and WIDER FACE datasets to demonstrate the effectiveness of the proposed approach. Experimental results show that the detection performance of small objects is greatly improved over state-of-the-art detectors.</p>

Intrinsic Relationship Reasoning for Small Object Detection

Inference Fusion with Associative Semantics for Unseen Object Detection

Relation Learning Reasoning Meets Tiny Object Tracking in Satellite Videos

Realize your surroundings: Exploiting context information for small object detection

Visual relationship detection with a deep convolutional relationship network

Deep Reasoning with Multi-Scale Context for Salient Object Detection

Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships

Improving small object detection via context-aware and feature-enhanced plug-and-play modules

Class‐Relation Reasoning with Knowledge‐Transfer for Few‐Shot Object Detection

Relation Networks for Object Detection

A Recurrent Reinforcement Learning Approach for Small Object Detection with Dynamic Refinement

Visual Relationship Detection with Multimodal Fusion and Reasoning

Structured Spatial Reasoning with Open Vocabulary Object Detectors

Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection

Visual Relationship Detection With Visual-Linguistic Knowledge From Multimodal Representations

Category-Contextual Relation Encoding Network for Few-Shot Object Detection

Discovering spatial context prototypes for object detection

Contextual Object Detection with Spatial Context Prototypes

Iterative Relation Reasoning for Multiple Object Recognition

Learning Human-Object Interaction via Interactive Semantic Reasoning

Relation-Aware Reasoning with Graph Convolutional Network.