Abstract:Deep learning technology has been extensively explored by existing methods to improve the performance of target detection in remote sensing images, due to its powerful feature extraction and representation abilities. However, these methods usually focus on the interior features of the target, but ignore the exterior semantic information around the target, especially the object-level relationship. Consequently, these methods fail to detect and recognize targets in the complex background where multiple objects crowd together. To handle this problem, a diversified context information fusion framework based on convolutional neural network (DCIFF-CNN) is proposed in this paper, which employs the structured object-level relationship to improve the target detection and recognition in complex backgrounds. The DCIFF-CNN is composed of two successive sub-networks, i.e., a multi-scale local context region proposal network (MLC-RPN) and an object-level relationship context target detection network (ORC-TDN). The MLC-RPN relies on the fine-grained details of objects to generate candidate regions in the remote sensing image. Then, the ORC-TDN utilizes the spatial context information of objects to detect and recognize targets by integrating an attentional message integrated module (AMIM) and an object relational structured graph (ORSG). The AMIM is integrated into the feed-forward CNN to highlight the useful object-level context information, while the ORSG builds the relations between a set of objects by processing their appearance features and geometric features. Finally, the target detection method based on DCIFF-CNN effectively represents the interior and exterior information of the target by exploiting both the multiscale local context information and the object-level relationships. Extensive experiments are conducted, and experimental results demonstrate that the proposed DCIFF-CNN method improves the target detection and recognition accuracy in complex backgrounds, showing superiority to other state-of-the-art methods.

DCL-Net: Augmenting the Capability of Classification and Localization for Remote Sensing Object Detection

FDLR-Net: A feature decoupling and localization refinement network for object detection in remote sensing images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote-Sensing Images

DO-Net: Dual-Output Network for Land Cover Classification From Optical Remote Sensing Images

Dual-Stream Feature Collaboration Perception Network for Salient Object Detection in Remote Sensing Images

MCDet: Multi-Content Collaboration Detector for Multiscale Remote Sensing Object

Cross-Modal Local Calibration and Global Context Modeling Network for RGB–Infrared Remote-Sensing Object Detection

Adaptive Discriminative Regions Learning Network for Remote Sensing Scene Classification

Collaborative Learning-based Network for Weakly Supervised Remote Sensing Object Detection

Differentiation of bursal secretory‐dendritic cells studied with anti‐vimentin monoclonal antibody

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images

Feature Enhancement Network for Object Detection in Optical Remote Sensing Images

Deep Convolutional Feature Enhancement for Remote Sensing Object Detection

Deep Adaptive Proposal Network for Object Detection in Optical Remote Sensing Images

Multigranularity Decoupling Network With Pseudolabel Selection for Remote Sensing Image Scene Classification

CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery

Structured Object-Level Relational Reasoning CNN-Based Target Detection Algorithm in a Remote Sensing Image

Exploiting Full-Scale Feature for Remote Sensing Object Detection Based on Refined Feature Mining and Adaptive Fusion

Decoupled Classification Refinement: Hard False Positive Suppression for Object Detection

A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images