Abstract:Although the orientation and scale properties of the objects in remote sensing images have been widely considered in the modern deep learning-based object detection methods, the spatial distribution property of objects has rarely been investigated. There is a distinct spatial distribution difference between close-range objects and remote sensing objects: the former may exhibit extensive mutual occlusion and overlap, whereas the latter rarely overlap. A current remote sensing object detection algorithm that ignores the spatial distribution difference may unnecessarily apply the massive anchor-based proposal bounding box generation and nonmaximum suppression (NMS) operations. In this article, considering the unique spatial distribution of remote sensing objects, and also the other spatial properties, we propose a novel, compact, and spatial-oriented object detection framework for remote sensing images. The proposed two-stage convolutional neural network (CNN) framework, which we call the Remote-sensing Spatial Adaptation DETector (RSADet), considers the spatial distribution, scale, and orientation/shape varieties of the objects in remote sensing images. In the first stage, each object instance is inferred on the scale-attention boosted CNN heatmaps to generate candidate bounding boxes, instead of using the anchor-based proposal box generation and NMS. In the second stage, deformable convolutions are introduced to adapt to the geometric variations of different object instances and to avoid the impact of complex and changeable backgrounds. A new bounding box confidence (IoU score) prediction branch is introduced as a convenient constraint for eliminating unreliable boxes and improving performance. Experiments were conducted on a large single-class remote sensing object detection dataset (the Ningbo Pylon dataset) built as part of this study and an open-source extraordinarily large multiclass dataset (the object DetectIon in Optical Remote sensing image (DIOR) dataset). Compared with the advanced detectors from both the computer vision and remote sensing communities, the proposed RSADet achieved state-of-the-art performance on both datasets.

Adaptive RANSAC and extended region-growing algorithm for object recognition over remote-sensing images

Reliable RANSAC using a novel preprocessing model.

An Automatic Algorithm for Object Recognition and Detection Based on ASIFT Keypoints

A New Method for Remote Sensing Image Matching by Integrating Affine Invariant Feature Extraction and RANSAC

Full Object Boundary Detection by Applying Scale Invariant Features in a Region Merging Segmentation Algorithm

Fast Object Retrieval Using Direct Spatial Matching

Automatic Registration of Multi-source Remote Sensing Images Based on Region Growing

An Object Detection Algorithm with Visual Perception for High-Resolution Remote Sensing Images

UNMANNED AERIAL VEHICLE IMAGE MATCHING BASED ON IMPROVED RANSAC ALGORITHM AND SURF ALGORITHM

An automatic region-based image segmentation algorithm for remote sensing applications

Object Detection Based on Adaptive Feature-Aware Method in Optical Remote Sensing Images

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

Adaptive clustering feature matching algorithm based on SIFT and RANSAC

A New Spatial-Oriented Object Detection Framework for Remote Sensing Images

ERF-RTMDet: An Improved Small Object Detection Method in Remote Sensing Images

RANSAC Back to SOTA: A Two-stage Consensus Filtering for Real-time 3D Registration

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

A Rotated Object Detection Strategy for Remote Sensing Images Using Misaligned Cross-Fusion Structures

Remote sensing image segmentation based on improved Mask-RCNN

Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor

A Self-Supplementary and Revised Network for Remote Sensing Object Detection