Abstract:Deep learning technology has been extensively explored by existing methods to improve the performance of target detection in remote sensing images, due to its powerful feature extraction and representation abilities. However, these methods usually focus on the interior features of the target, but ignore the exterior semantic information around the target, especially the object-level relationship. Consequently, these methods fail to detect and recognize targets in the complex background where multiple objects crowd together. To handle this problem, a diversified context information fusion framework based on convolutional neural network (DCIFF-CNN) is proposed in this paper, which employs the structured object-level relationship to improve the target detection and recognition in complex backgrounds. The DCIFF-CNN is composed of two successive sub-networks, i.e., a multi-scale local context region proposal network (MLC-RPN) and an object-level relationship context target detection network (ORC-TDN). The MLC-RPN relies on the fine-grained details of objects to generate candidate regions in the remote sensing image. Then, the ORC-TDN utilizes the spatial context information of objects to detect and recognize targets by integrating an attentional message integrated module (AMIM) and an object relational structured graph (ORSG). The AMIM is integrated into the feed-forward CNN to highlight the useful object-level context information, while the ORSG builds the relations between a set of objects by processing their appearance features and geometric features. Finally, the target detection method based on DCIFF-CNN effectively represents the interior and exterior information of the target by exploiting both the multiscale local context information and the object-level relationships. Extensive experiments are conducted, and experimental results demonstrate that the proposed DCIFF-CNN method improves the target detection and recognition accuracy in complex backgrounds, showing superiority to other state-of-the-art methods.

Remote Sensing Image Scene Classification Based on Object Relationship Reasoning CNN

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Target Detection in Remote Sensing Image Based on Object-and-Scene Context Constrained CNN

Scene Classification Of High Resolution Remote Sensing Images Using Convolutional Neural Networks

Structured Object-Level Relational Reasoning CNN-Based Target Detection Algorithm in a Remote Sensing Image

Relation-Attention Networks for Remote Sensing Scene Classification

Remote Sensing Image Scene Classification Using CNN-CapsNet

High-Resolution Remote Sensing Image Classification Method Based on Convolutional Neural Network and Restricted Conditional Random Field

Remote Sensing Scene Classification by Gated Bidirectional Network

A survey of remote sensing image classification based on CNNs

Remote Sensing Image Scene Classification Based on an Enhanced Attention Module

Remote Sensing Image Scene Classification Based on Global Self-Attention Module

Object Detection in Remote Sensing Images Based on a Scene-Contextual Feature Pyramid Network

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification.

Spatial Information Considered Network for Scene Classification

Remote sensing image scene classification based on multilayer feature context encoding network

An Efficient and Lightweight Convolutional Neural Network for Remote Sensing Image Scene Classification

Effective Multiscale Residual Network With High-Order Feature Representation for Optical Remote Sensing Scene Classification

Semi-Supervised Scene Classification for Remote Sensing Images Based on CNN and Ensemble Learning.