Abstract:The detection of arbitrary-oriented and multi-scale objects in satellite optical imagery is an important task in remote sensing and computer vision. Despite significant research efforts, such detection remains largely unsolved due to the diversity of patterns in orientation, scale, aspect ratio, and visual appearance; the dense distribution of objects; and extreme imbalances in categories. In this paper, we propose an adaptive dynamic refined single-stage transformer detector to address the aforementioned challenges, aiming to achieve high recall and speed. Our detector realizes rotated object detection with RetinaNet as the baseline. Firstly, we propose a feature pyramid transformer (FPT) to enhance feature extraction of the rotated object detection framework through a feature interaction mechanism. This is beneficial for the detection of objects with diverse patterns in terms of scale, aspect ratio, visual appearance, and dense distributions. Secondly, we design two special post-processing steps for rotated objects with arbitrary orientations, large aspect ratios and dense distributions. The output features of FPT are fed into post-processing steps. In the first step, it performs the preliminary regression of locations and angle anchors for the refinement step. In the refinement step, it performs adaptive feature refinement first and then gives the final object detection result precisely. The main architecture of the refinement step is dynamic feature refinement (DFR), which is proposed to adaptively adjust the feature map and reconstruct a new feature map for arbitrary-oriented object detection to alleviate the mismatches between rotated bounding boxes and axis-aligned receptive fields. Thirdly, the focus loss is adopted to deal with the category imbalance problem. Experiments on two challenging satellite optical imagery public datasets, DOTA and HRSC2016, demonstrate that the proposed ADT-Det detector achieves a state-of-the-art detection accuracy (79.95% mAP for DOTA and 93.47% mAP for HRSC2016) while running very fast (14.6 fps with a 600 × 600 input image size).

Coupled Dual-Frequency Phase-Shifting Coder for Precise Rotated Angle Representation in Oriented Object Detection

Trigonometric-Coded Refined Detector for High Precision Oriented Object Detection

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

Highly Efficient Anchor-Free Oriented Small Object Detection for Remote Sensing Images via Periodic Pseudo-Domain

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

Oriented RepPoints for Aerial Object Detection

Dual-Aligned Oriented Detector

Oriented Object Detection with Fine-Grained Enhancement and Angle Constraint

Learning Orientation-Aware Distances for Oriented Object Detection

A Refined Single-Stage Detector With Feature Enhancement and Alignment for Oriented Objects

RAOD: refined oriented detector with augmented feature in remote sensing images object detection

Precise Orientation Estimation for Rotated Object Detection Based on a Unit Vector Coding Approach

On Improving Bounding Box Representations for Oriented Object Detection

Metric-aligned Sample Selection and Critical Feature Sampling for Oriented Object Detection

RiDOP: A Rotation-Invariant Detector with Simple Oriented Proposals in Remote Sensing Images

Oriented objects as pairs of middle lines

ADT-Det: Adaptive Dynamic Refined Single-Stage Transformer Detector for Arbitrary-Oriented Object Detection in Satellite Optical Imagery

Category-Aware Dynamic Label Assignment with High-Quality Oriented Proposal

High-Quality Angle Prediction for Oriented Object Detection in Remote Sensing Images.

ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detection

SAFDet: A Semi-Anchor-Free Detector for Effective Detection of Oriented Objects in Aerial Images