Abstract:Object detection in remote-sensing images (RSIs) is always a vibrant research topic in the remote-sensing community. Recently, deep-convolutional-neural-network (CNN)-based methods, including region-CNN-based and You-Only-Look-Once-based methods, have become the de-facto standard for RSI object detection. CNNs are good at local feature extraction but they have limitations in capturing global features. However, the attention-based transformer can obtain the relationships of RSI at a long distance. Therefore, the Transformer for Remote-Sensing Object detection (TRD) is investigated in this study. Specifically, the proposed TRD is a combination of a CNN and a multiple-layer Transformer with encoders and decoders. To detect objects from RSIs, a modified Transformer is designed to aggregate features of global spatial positions on multiple scales and model the interactions between pairwise instances. Then, due to the fact that the source data set (e.g., ImageNet) and the target data set (i.e., RSI data set) are quite different, to reduce the difference between the data sets, the TRD with the transferring CNN (T-TRD) based on the attention mechanism is proposed to adjust the pre-trained model for better RSI object detection. Because the training of the Transformer always needs abundant, well-annotated training samples, and the number of training samples for RSI object detection is usually limited, in order to avoid overfitting, data augmentation is combined with a Transformer to improve the detection performance of RSI. The proposed T-TRD with data augmentation (T-TRD-DA) is tested on the two widely-used data sets (i.e., NWPU VHR-10 and DIOR) and the experimental results reveal that the proposed models provide competitive results (i.e., centuple mean average precision of 87.9 and 66.8 with at most 5.9 and 2.4 higher than the comparison methods on the NWPU VHR-10 and the DIOR data sets, respectively) compared to the competitive benchmark methods, which shows that the Transformer-based method opens a new window for RSI object detection.

Transformer-Based Few-Shot Object Detection with Multi-Relation Matching for Remote Sensing Images

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

Few-Shot Object Detection with Multi-level Information Interaction for Optical Remote Sensing Images

TMD-FS - Improving Few-Shot Object Detection with Transformer Multi-modal Directing.

Transformer with Transfer CNN for Remote-Sensing-Image Object Detection

HFSI-TF: Hierarchical Full-Scale Interactive Transformer Model for Object Detection in Remote Sensing Image

Few-Shot Object Detection with Local Feature Enhancement and Feature Interrelation

Few-Shot Object Detection Based on Contrastive Class-Attention Feature Reweighting for Remote Sensing Images

Multimodal Transformer Using Cross-Channel attention for Object Detection in Remote Sensing Images

Few-Shot Object Detection With Multilevel Information Interaction for Optical Remote Sensing Images

Efficient Meta-Learning Enabled Lightweight Multiscale Few-Shot Object Detection in Remote Sensing Images

Transformer-Based Object Detection with Deep Feature Fusion Using Carafe Operator in Remote Sensing Image

Multi-scale Self-attention-based Few-shot Object Detection for Remote Sensing Images.

Few-Shot Object Detection in Remote Sensing Images with Multi-Scale Spatial Selective Attention

Multi-Modal Prototypes for Few-Shot Object Detection in Remote Sensing Images

Adaptive Dual-Stream Sparse Transformer Network for Salient Object Detection in Optical Remote Sensing Images

Remote Sensing Object Detection Based on Strong Feature Extraction and Prescreening Network

Text Semantic Fusion Relation Graph Reasoning for Few-Shot Object Detection on Remote Sensing Images

Few-Shot Object Detection with Self-Adaptive Global Similarity and Two-Way Foreground Stimulator in Remote Sensing Images

Class‐Relation Reasoning with Knowledge‐Transfer for Few‐Shot Object Detection

Few-Shot Object Detection in Remote Sensing Image Interpretation: Opportunities and Challenges