Abstract:Object detection in remote-sensing images (RSIs) is always a vibrant research topic in the remote-sensing community. Recently, deep-convolutional-neural-network (CNN)-based methods, including region-CNN-based and You-Only-Look-Once-based methods, have become the de-facto standard for RSI object detection. CNNs are good at local feature extraction but they have limitations in capturing global features. However, the attention-based transformer can obtain the relationships of RSI at a long distance. Therefore, the Transformer for Remote-Sensing Object detection (TRD) is investigated in this study. Specifically, the proposed TRD is a combination of a CNN and a multiple-layer Transformer with encoders and decoders. To detect objects from RSIs, a modified Transformer is designed to aggregate features of global spatial positions on multiple scales and model the interactions between pairwise instances. Then, due to the fact that the source data set (e.g., ImageNet) and the target data set (i.e., RSI data set) are quite different, to reduce the difference between the data sets, the TRD with the transferring CNN (T-TRD) based on the attention mechanism is proposed to adjust the pre-trained model for better RSI object detection. Because the training of the Transformer always needs abundant, well-annotated training samples, and the number of training samples for RSI object detection is usually limited, in order to avoid overfitting, data augmentation is combined with a Transformer to improve the detection performance of RSI. The proposed T-TRD with data augmentation (T-TRD-DA) is tested on the two widely-used data sets (i.e., NWPU VHR-10 and DIOR) and the experimental results reveal that the proposed models provide competitive results (i.e., centuple mean average precision of 87.9 and 66.8 with at most 5.9 and 2.4 higher than the comparison methods on the NWPU VHR-10 and the DIOR data sets, respectively) compared to the competitive benchmark methods, which shows that the Transformer-based method opens a new window for RSI object detection.

Capsule-inferenced Object Detection for Remote Sensing Images.

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

PR-Deformable DETR: DETR for Remote Sensing Object Detection

An Improved DETR Based on Angle Denoising and Oriented Boxes Refinement for Remote Sensing Object Detection

DETR-ORD: An Improved DETR Detector for Oriented Remote Sensing Object Detection with Feature Reconstruction and Dynamic Query

Remote Sensing Object Detection Based on Strong Feature Extraction and Prescreening Network

Fully Transformer Detector with Multiscale Encoder and Dynamic Decoder

Feature Correlation-Steered Capsule Network for Object Detection.

Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection

CLT-Det: Correlation Learning Based on Transformer for Detecting Dense Objects in Remote Sensing Images

Sparse Anchoring Guided High-Resolution Capsule Network for Geospatial Object Detection from Remote Sensing Imagery

Self-Distillated DETR for Object Detection in Complex Environments

CF-DETR: Coarse-to-Fine Transformers for End-to-End Object Detection

Transformer-Based Object Detection with Deep Feature Fusion Using Carafe Operator in Remote Sensing Image

Anchor DETR: Query Design for Transformer-Based Detector

Investigating the Robustness and Properties of Detection Transformers (DETR) Toward Difficult Images

Transformer Based Remote Sensing Object Detection with Enhanced Multispectral Feature Extraction.

DETR++: Taming Your Multi-Scale Detection Transformer

DFS-DETR: Detailed-Feature-Sensitive Detector for Small Object Detection in Aerial Images Using Transformer

QETR: A Query-Enhanced Transformer for Remote Sensing Image Object Detection

Transformer with Transfer CNN for Remote-Sensing-Image Object Detection