Abstract:Although the orientation and scale properties of the objects in remote sensing images have been widely considered in the modern deep learning-based object detection methods, the spatial distribution property of objects has rarely been investigated. There is a distinct spatial distribution difference between close-range objects and remote sensing objects: the former may exhibit extensive mutual occlusion and overlap, whereas the latter rarely overlap. A current remote sensing object detection algorithm that ignores the spatial distribution difference may unnecessarily apply the massive anchor-based proposal bounding box generation and nonmaximum suppression (NMS) operations. In this article, considering the unique spatial distribution of remote sensing objects, and also the other spatial properties, we propose a novel, compact, and spatial-oriented object detection framework for remote sensing images. The proposed two-stage convolutional neural network (CNN) framework, which we call the Remote-sensing Spatial Adaptation DETector (RSADet), considers the spatial distribution, scale, and orientation/shape varieties of the objects in remote sensing images. In the first stage, each object instance is inferred on the scale-attention boosted CNN heatmaps to generate candidate bounding boxes, instead of using the anchor-based proposal box generation and NMS. In the second stage, deformable convolutions are introduced to adapt to the geometric variations of different object instances and to avoid the impact of complex and changeable backgrounds. A new bounding box confidence (IoU score) prediction branch is introduced as a convenient constraint for eliminating unreliable boxes and improving performance. Experiments were conducted on a large single-class remote sensing object detection dataset (the Ningbo Pylon dataset) built as part of this study and an open-source extraordinarily large multiclass dataset (the object DetectIon in Optical Remote sensing image (DIOR) dataset). Compared with the advanced detectors from both the computer vision and remote sensing communities, the proposed RSADet achieved state-of-the-art performance on both datasets.

DDE-Net: Dynamic Density-Driven Estimation for Arbitrary-Oriented Object Detection

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

EB-Net: an efficient balanced network for accuracy and speed of remote sensing detection

Dense Object Detection Based on De-Homogenized Queries

A Refined Hybrid Network for Object Detection in Aerial Images

Highly Efficient Anchor-Free Oriented Small Object Detection for Remote Sensing Images via Periodic Pseudo-Domain

Center-Boundary Dual Attention for Oriented Object Detection in Remote Sensing Images

A Novel Adaptive Edge Aggregation and Multiscale Feature Interaction Detector for Object Detection in Remote Sensing Images

SDSDet: A real-time object detector for small, dense, multi-scale remote sensing objects

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

EARL: An Elliptical Distribution Aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Images

A New Spatial-Oriented Object Detection Framework for Remote Sensing Images

Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images

Feature Enhancement Based Oriented Object Detection in Remote Sensing Images

RADet: Refine Feature Pyramid Network and Multi-Layer Attention Network for Arbitrary-Oriented Object Detection of Remote Sensing Images

Drone-DETR: Efficient Small Object Detection for Remote Sensing Image Using Enhanced RT-DETR Model

Arbitrarily Oriented Dense Object Detection Based on Center Point Network in Remote Sensing Images

DASANet: A 3D Object Detector with Density-and-Sparsity Feature Aggregation

ADT-Det: Adaptive Dynamic Refined Single-Stage Transformer Detector for Arbitrary-Oriented Object Detection in Satellite Optical Imagery

CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery

An Improved DETR Based on Angle Denoising and Oriented Boxes Refinement for Remote Sensing Object Detection