Abstract:Although the orientation and scale properties of the objects in remote sensing images have been widely considered in the modern deep learning-based object detection methods, the spatial distribution property of objects has rarely been investigated. There is a distinct spatial distribution difference between close-range objects and remote sensing objects: the former may exhibit extensive mutual occlusion and overlap, whereas the latter rarely overlap. A current remote sensing object detection algorithm that ignores the spatial distribution difference may unnecessarily apply the massive anchor-based proposal bounding box generation and nonmaximum suppression (NMS) operations. In this article, considering the unique spatial distribution of remote sensing objects, and also the other spatial properties, we propose a novel, compact, and spatial-oriented object detection framework for remote sensing images. The proposed two-stage convolutional neural network (CNN) framework, which we call the Remote-sensing Spatial Adaptation DETector (RSADet), considers the spatial distribution, scale, and orientation/shape varieties of the objects in remote sensing images. In the first stage, each object instance is inferred on the scale-attention boosted CNN heatmaps to generate candidate bounding boxes, instead of using the anchor-based proposal box generation and NMS. In the second stage, deformable convolutions are introduced to adapt to the geometric variations of different object instances and to avoid the impact of complex and changeable backgrounds. A new bounding box confidence (IoU score) prediction branch is introduced as a convenient constraint for eliminating unreliable boxes and improving performance. Experiments were conducted on a large single-class remote sensing object detection dataset (the Ningbo Pylon dataset) built as part of this study and an open-source extraordinarily large multiclass dataset (the object DetectIon in Optical Remote sensing image (DIOR) dataset). Compared with the advanced detectors from both the computer vision and remote sensing communities, the proposed RSADet achieved state-of-the-art performance on both datasets.

An Optimized Faster R-CNN Method Based on DRNet and RoI Align for Building Detection in Remote Sensing Images

Application of mask R-CNN for building detection in UAV remote sensing images

Accurate Object Detection Based on Faster R-CNN in Remote Sensing Imagery

Method of Building Detection in Optical Remote Sensing Images Based on SegFormer

Remote sensing image building detection method based on Mask R-CNN

TRDet: Two-Stage Rotated Detection of Rural Buildings in Remote Sensing Images

A Deep Learning Based Objection Detection Method for High Resolution Remote Sensing Image

Identifying Damaged Buildings in Aerial Images Using the Object Detection Method

An Efficient And Robust Integrated Geospatial Object Detection Framework For High Spatial Resolution Remote Sensing Imagery

Deconv R-Cnn For Small Object Detection On Remote Sensing Images

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

A Refined and Efficient CNN Algorithm for Remote Sensing Object Detection

Improved Oriented Object Detection in Remote Sensing Images Based on a Three-Point Regression Method

RADet: Refine Feature Pyramid Network and Multi-Layer Attention Network for Arbitrary-Oriented Object Detection of Remote Sensing Images

R&D-Net: Integration of Registration-Net and Detection-Net for Identifying Building Changes in High Spatial-Resolution Remote Sensing Images

Research on efficient detection network method for remote sensing images based on self attention mechanism

Learning Orientation-Estimation Convolutional Neural Network for Building Detection in Optical Remote Sensing Image

Improving remote sensing object detection by using feature extraction and rotational equivariant attention

Automatic Building Extraction from Google Earth Images under Complex Backgrounds Based on Deep Instance Segmentation Network

A Multi-Branch Feature Fusion Network for Building Detection in Remote Sensing Images

A New Spatial-Oriented Object Detection Framework for Remote Sensing Images