Abstract:Deep learning technology has been extensively explored by existing methods to improve the performance of target detection in remote sensing images, due to its powerful feature extraction and representation abilities. However, these methods usually focus on the interior features of the target, but ignore the exterior semantic information around the target, especially the object-level relationship. Consequently, these methods fail to detect and recognize targets in the complex background where multiple objects crowd together. To handle this problem, a diversified context information fusion framework based on convolutional neural network (DCIFF-CNN) is proposed in this paper, which employs the structured object-level relationship to improve the target detection and recognition in complex backgrounds. The DCIFF-CNN is composed of two successive sub-networks, i.e., a multi-scale local context region proposal network (MLC-RPN) and an object-level relationship context target detection network (ORC-TDN). The MLC-RPN relies on the fine-grained details of objects to generate candidate regions in the remote sensing image. Then, the ORC-TDN utilizes the spatial context information of objects to detect and recognize targets by integrating an attentional message integrated module (AMIM) and an object relational structured graph (ORSG). The AMIM is integrated into the feed-forward CNN to highlight the useful object-level context information, while the ORSG builds the relations between a set of objects by processing their appearance features and geometric features. Finally, the target detection method based on DCIFF-CNN effectively represents the interior and exterior information of the target by exploiting both the multiscale local context information and the object-level relationships. Extensive experiments are conducted, and experimental results demonstrate that the proposed DCIFF-CNN method improves the target detection and recognition accuracy in complex backgrounds, showing superiority to other state-of-the-art methods.

Deep-Learning-Based Object-Level Contour Detection With Ccg And Crf Optimization

Object Contour Detection with a Fully Convolutional Encoder-Decoder Network

DeepEdge: A multi-scale bifurcated deep network for top-down contour detection

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Object Detection in VHR Image Using Transfer Learning with Deformable Convolution

CF-lines: a Fusing Contour Features Optimization Method for Line Segment Detector

Image Contour Detection Based on Visual Pathway Information Transfer Mechanism

Deep feature based contextual model for object detection

Structured Object-Level Relational Reasoning CNN-Based Target Detection Algorithm in a Remote Sensing Image

Contour Segment Grouping for Object Detection.

Pixel-wise Deep Learning for Contour Detection

Contour detection in Cassini ISS images based on Hierarchical Extreme Learning Machine and Dense Conditional Random Field

Object Contour and Edge Detection with RefineContourNet

Contour deformation network for instance segmentation

A feature aggregation network for contour detection inspired by complex cells properties

Recent Advances in the Applications of Convolutional Neural Networks to Medical Image Contour Detection

Contour Detection Using Cost-Sensitive Convolutional Neural Networks

Object detection and recognition using contour based edge detection and fast R-CNN

Deep Active Contours for Real-time 6-Dof Object Tracking

A Gestaltist approach to contour-based object recognition: Combining bottom-up and top-down cues