Abstract:Unsupervised domain adaptation (UDA) is critical for remote sensing object detection in real applications, aiming to address the significant performance degradation issue caused by the domain gap between the source and target domain. This method achieves cross-domain alignment by leveraging the unlabeled target domain data, thus avoiding the expensive annotation cost. However, existing works mainly cope with convolutional neural network (CNN)-based object detectors, which are characterized by complex adversarial learning architecture and fail to accurately align the features in remote sensing images with sparsely allocated objects and inevitable background noise. Compared to CNN-based methods, the detection transformer (DETR) largely simplifies the object detection pipeline and demonstrates the great potential of its intrinsic characteristics of global relation modeling between any pixels. On this basis, we propose the first strong DETR-based baseline, remote sensing teacher, for UDA in remote sensing object detection. Specifically, the remote sensing teacher introduces an innovative learnable frequency-enhanced feature alignment (LFA) module. Within this module, we initially transform the features into frequency space to simplify the attention solver and effectively capture domain-specific information. Subsequently, the module significantly enhances the global feature representations of sparsely allocated objects by using a lightweight attention mechanism. Following this, the module incorporates learnable filters with a gated mechanism, enabling selective alignment of features in noisy backgrounds. In addition, the remote sensing teacher employs a self-adaptive pseudo-label assigner (SPA) that can automatically adjust the class-wise confidence threshold according to the model’s learning status, thereby enabling the generation of high-quality pseudo-labels in scenarios with a long-tailed distribution. Leveraging these pseudo-labels further mitigates the domain bias of the detector by establishing alignment at the label level. Extensive experimental results demonstrate the superior performance and generalization capabilities of our proposed remote sensing teacher in multiple remote sensing adaptation scenarios. The Code is released at https://github.com/h751410234/RemoteSensingTeacher.

Unsupervised Transfer Learning Using For Multi-Model Remote Sensing Data Classification

An Unsupervised Domain Adaptation Method for Multi-Modal Remote Sensing Image Classification

On the Transferability of Learning Models for Semantic Segmentation for Remote Sensing Data

Unsupervised Mixed Multi-Target Domain Adaptation for Remote Sensing Images Classification

A General Transitive Transfer Learning Framework for Cross-Optical Sensor Remote Sensing Image Scene Understanding

Transfer learning in environmental remote sensing

Transferring CNN With Adaptive Learning for Remote Sensing Scene Classification

Unsupervised domain adaptation for remote sensing semantic segmentation with the 2D discrete wavelet transform

Trans-Diff: Heterogeneous Domain Adaptation for Remote Sensing Segmentation With Transfer Diffusion

Optimal transport-based domain adaptation for semantic segmentation of remote sensing images

Multilevel Unsupervised Domain Adaptation for Single-Stage Object Detection in Remote Sensing Images

A Fine-Grained Unsupervised Domain Adaptation Framework for Semantic Segmentation of Remote Sensing Images

Classification of small-scale hyperspectral images with multi-source deep transfer learning

Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification

Semi-Supervised Deep learning via Transformation Consistency Regularization for Remote Sensing Image Semantic Segmentation

Domain Adaptive Remote Sensing Scene Recognition via Semantic Relationship Knowledge Transfer

Deep Learning Model Transfer in Forest Mapping using Multi-source Satellite SAR and Optical Images

Cross-Domain Urban Land Use Classification via Scenewise Unsupervised Multisource Domain Adaptation With Transformer

Remote Sensing Teacher: Cross-Domain Detection Transformer with Learnable Frequency-Enhanced Feature Alignment in Remote Sensing Imagery

Self-Training-Based Unsupervised Domain Adaptation for Object Detection in Remote Sensing Imagery

Recent Advances in Domain Adaptation for the Classification of Remote Sensing Data