Abstract:Although the orientation and scale properties of the objects in remote sensing images have been widely considered in the modern deep learning-based object detection methods, the spatial distribution property of objects has rarely been investigated. There is a distinct spatial distribution difference between close-range objects and remote sensing objects: the former may exhibit extensive mutual occlusion and overlap, whereas the latter rarely overlap. A current remote sensing object detection algorithm that ignores the spatial distribution difference may unnecessarily apply the massive anchor-based proposal bounding box generation and nonmaximum suppression (NMS) operations. In this article, considering the unique spatial distribution of remote sensing objects, and also the other spatial properties, we propose a novel, compact, and spatial-oriented object detection framework for remote sensing images. The proposed two-stage convolutional neural network (CNN) framework, which we call the Remote-sensing Spatial Adaptation DETector (RSADet), considers the spatial distribution, scale, and orientation/shape varieties of the objects in remote sensing images. In the first stage, each object instance is inferred on the scale-attention boosted CNN heatmaps to generate candidate bounding boxes, instead of using the anchor-based proposal box generation and NMS. In the second stage, deformable convolutions are introduced to adapt to the geometric variations of different object instances and to avoid the impact of complex and changeable backgrounds. A new bounding box confidence (IoU score) prediction branch is introduced as a convenient constraint for eliminating unreliable boxes and improving performance. Experiments were conducted on a large single-class remote sensing object detection dataset (the Ningbo Pylon dataset) built as part of this study and an open-source extraordinarily large multiclass dataset (the object DetectIon in Optical Remote sensing image (DIOR) dataset). Compared with the advanced detectors from both the computer vision and remote sensing communities, the proposed RSADet achieved state-of-the-art performance on both datasets.

Spatial Enhanced-SSD For Multiclass Object Detection in Remote Sensing Images

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Attention and Feature Fusion SSD for Remote Sensing Object Detection.

SAFF-SSD: Self-Attention Combined Feature Fusion-Based SSD for Small Object Detection in Remote Sensing

A Novel Deep Learning‐based Single Shot Multibox Detector Model for Object Detection in Optical Remote Sensing Images

CDD-Net: A Context-Driven Detection Network for Multiclass Object Detection

Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxes

Semantic Context-Aware Network for Multiscale Object Detection in Remote Sensing Images

On-Board Multi-Class Geospatial Object Detection Based on Convolutional Neural Network for High Resolution Remote Sensing Images

Multiscale Object Detection Algorithm for Satellite Remote-Sensing Images

Object Detection in High-Resolution Panchromatic Images Using Deep Models and Spatial Template Matching

AF-SSD: An Accurate and Fast Single Shot Detector for High Spatial Remote Sensing Imagery

Learning object-wise semantic representation for detection in remote sensing imagery

YOLO-SSP: an object detection model based on pyramid spatial attention and improved downsampling strategy for remote sensing images

Small Object Detection in Remote Sensing Images Based on Target Cluster and Multi-Scale Prediction

A New Spatial-Oriented Object Detection Framework for Remote Sensing Images

Spatial hierarchy perception and hard samples metric learning for high-resolution remote sensing image object detection

SDSDet: A real-time object detector for small, dense, multi-scale remote sensing objects

SSD: Single Shot MultiBox Detector

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images