Abstract:Object detection in remote-sensing images (RSIs) is always a vibrant research topic in the remote-sensing community. Recently, deep-convolutional-neural-network (CNN)-based methods, including region-CNN-based and You-Only-Look-Once-based methods, have become the de-facto standard for RSI object detection. CNNs are good at local feature extraction but they have limitations in capturing global features. However, the attention-based transformer can obtain the relationships of RSI at a long distance. Therefore, the Transformer for Remote-Sensing Object detection (TRD) is investigated in this study. Specifically, the proposed TRD is a combination of a CNN and a multiple-layer Transformer with encoders and decoders. To detect objects from RSIs, a modified Transformer is designed to aggregate features of global spatial positions on multiple scales and model the interactions between pairwise instances. Then, due to the fact that the source data set (e.g., ImageNet) and the target data set (i.e., RSI data set) are quite different, to reduce the difference between the data sets, the TRD with the transferring CNN (T-TRD) based on the attention mechanism is proposed to adjust the pre-trained model for better RSI object detection. Because the training of the Transformer always needs abundant, well-annotated training samples, and the number of training samples for RSI object detection is usually limited, in order to avoid overfitting, data augmentation is combined with a Transformer to improve the detection performance of RSI. The proposed T-TRD with data augmentation (T-TRD-DA) is tested on the two widely-used data sets (i.e., NWPU VHR-10 and DIOR) and the experimental results reveal that the proposed models provide competitive results (i.e., centuple mean average precision of 87.9 and 66.8 with at most 5.9 and 2.4 higher than the comparison methods on the NWPU VHR-10 and the DIOR data sets, respectively) compared to the competitive benchmark methods, which shows that the Transformer-based method opens a new window for RSI object detection.

RT-SNDETR: real-time supernova detection via end-to-end image transformers

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

RT-DETRv3: Real-time End-to-End Object Detection with Hierarchical Dense Positive Supervision

DETRs Beat YOLOs on Real-time Object Detection

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Transformer with Transfer CNN for Remote-Sensing-Image Object Detection

Identifying Transients in the Dark Energy Survey using Convolutional Neural Networks

Improved Real-Time Detection Transformer-Based Rail Fastener Defect Detection Algorithm

ESRTMDet: An End-to-End Super-Resolution Enhanced Real-Time Rotated Object Detector for Degraded Aerial Images

RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer

A DeNoising FPN With Transformer R-CNN for Tiny Object Detection

TransientViT: A novel CNN - Vision Transformer hybrid real/bogus transient classifier for the Kilodegree Automatic Transient Survey

Towards Data-Efficient Detection Transformers

Improving supernova detection by using YOLOv8 for astronomical image analysis

Supervised Transformer Network for Efficient Face Detection

Van-DETR: enhanced real-time object detection with vanillanet and advanced feature fusion

TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution

DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image

Detection, instance segmentation, and classification for astronomical surveys with deep learning ( deepdisc ): detectron2 implementation and demonstration with Hyper Suprime-Cam data

High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images