Abstract:The detection of arbitrary-oriented and multi-scale objects in satellite optical imagery is an important task in remote sensing and computer vision. Despite significant research efforts, such detection remains largely unsolved due to the diversity of patterns in orientation, scale, aspect ratio, and visual appearance; the dense distribution of objects; and extreme imbalances in categories. In this paper, we propose an adaptive dynamic refined single-stage transformer detector to address the aforementioned challenges, aiming to achieve high recall and speed. Our detector realizes rotated object detection with RetinaNet as the baseline. Firstly, we propose a feature pyramid transformer (FPT) to enhance feature extraction of the rotated object detection framework through a feature interaction mechanism. This is beneficial for the detection of objects with diverse patterns in terms of scale, aspect ratio, visual appearance, and dense distributions. Secondly, we design two special post-processing steps for rotated objects with arbitrary orientations, large aspect ratios and dense distributions. The output features of FPT are fed into post-processing steps. In the first step, it performs the preliminary regression of locations and angle anchors for the refinement step. In the refinement step, it performs adaptive feature refinement first and then gives the final object detection result precisely. The main architecture of the refinement step is dynamic feature refinement (DFR), which is proposed to adaptively adjust the feature map and reconstruct a new feature map for arbitrary-oriented object detection to alleviate the mismatches between rotated bounding boxes and axis-aligned receptive fields. Thirdly, the focus loss is adopted to deal with the category imbalance problem. Experiments on two challenging satellite optical imagery public datasets, DOTA and HRSC2016, demonstrate that the proposed ADT-Det detector achieves a state-of-the-art detection accuracy (79.95% mAP for DOTA and 93.47% mAP for HRSC2016) while running very fast (14.6 fps with a 600 × 600 input image size).

Sparse Transformer Based Remote Sensing Rotated Object Detection

ADT-Det: Adaptive Dynamic Refined Single-Stage Transformer Detector for Arbitrary-Oriented Object Detection in Satellite Optical Imagery

A Rotated Object Detection Strategy for Remote Sensing Images Using Misaligned Cross-Fusion Structures

CLT-Det: Correlation Learning Based on Transformer for Detecting Dense Objects in Remote Sensing Images

Remote Sensing Image Target Detection Method Based on Refined Feature Extraction

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

R-YOLO: A YOLO-Based Method for Arbitrary-Oriented Target Detection in High-Resolution Remote Sensing Images

Remote Sensing Object Detection Based on Strong Feature Extraction and Prescreening Network

Transformer with Transfer CNN for Remote-Sensing-Image Object Detection

Rotating object detection in remote-sensing environment

RADet: Refine Feature Pyramid Network and Multi-Layer Attention Network for Arbitrary-Oriented Object Detection of Remote Sensing Images

Efficient Inductive Vision Transformer for Oriented Object Detection in Remote Sensing Imagery

High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images

Remote Sensing Image Rotation Target Detection Algorithm Based on Attention Mechanism

YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement

RotaTR: Detection Transformer for Dense and Rotated Object

SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects

Transformer-Based Multi-layer Feature Aggregation and Rotated Anchor Matching for Oriented Object Detection in Remote Sensing Images

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

Arbitrarily Oriented Dense Object Detection Based on Center Point Network in Remote Sensing Images

DETR-ORD: An Improved DETR Detector for Oriented Remote Sensing Object Detection with Feature Reconstruction and Dynamic Query