Abstract:Unsupervised domain adaptation (UDA) is critical for remote sensing object detection in real applications, aiming to address the significant performance degradation issue caused by the domain gap between the source and target domain. This method achieves cross-domain alignment by leveraging the unlabeled target domain data, thus avoiding the expensive annotation cost. However, existing works mainly cope with convolutional neural network (CNN)-based object detectors, which are characterized by complex adversarial learning architecture and fail to accurately align the features in remote sensing images with sparsely allocated objects and inevitable background noise. Compared to CNN-based methods, the detection transformer (DETR) largely simplifies the object detection pipeline and demonstrates the great potential of its intrinsic characteristics of global relation modeling between any pixels. On this basis, we propose the first strong DETR-based baseline, remote sensing teacher, for UDA in remote sensing object detection. Specifically, the remote sensing teacher introduces an innovative learnable frequency-enhanced feature alignment (LFA) module. Within this module, we initially transform the features into frequency space to simplify the attention solver and effectively capture domain-specific information. Subsequently, the module significantly enhances the global feature representations of sparsely allocated objects by using a lightweight attention mechanism. Following this, the module incorporates learnable filters with a gated mechanism, enabling selective alignment of features in noisy backgrounds. In addition, the remote sensing teacher employs a self-adaptive pseudo-label assigner (SPA) that can automatically adjust the class-wise confidence threshold according to the model’s learning status, thereby enabling the generation of high-quality pseudo-labels in scenarios with a long-tailed distribution. Leveraging these pseudo-labels further mitigates the domain bias of the detector by establishing alignment at the label level. Extensive experimental results demonstrate the superior performance and generalization capabilities of our proposed remote sensing teacher in multiple remote sensing adaptation scenarios. The Code is released at https://github.com/h751410234/RemoteSensingTeacher.

Versatile Teacher: A class-aware teacher–student framework for cross-domain adaptation

Versatile Teacher: A Class-aware Teacher-student Framework for Cross-domain Adaptation

Cross-Domain Adaptive Teacher for Object Detection

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

CAT: Exploiting Inter-Class Dynamics for Domain Adaptive Object Detection

Cross-Domain Object Detection through Consistent and Contrastive Teacher with Fourier Transform

Cross Domain Object Detection via Multi-Granularity Confidence Alignment based Mean Teacher

Style-Guided Adversarial Teacher for Cross-Domain Object Detection

Exploring Object Relation in Mean Teacher for Cross-Domain Detection

DATR: Unsupervised Domain Adaptive Detection Transformer with Dataset-Level Adaptation and Prototypical Alignment

Multi-adversarial Faster-RCNN with Paradigm Teacher for Unrestricted Object Detection

Harmonious Teacher for Cross-Domain Object Detection

Source-free domain adaptive object detection based on pseudo-supervised mean teacher

Unbiased Mean Teacher for Cross-domain Object Detection

Cross-Domain Object Detection by Dual Adaptive Branch

Balanced Teacher for Source-free Object Detection

CMT: Co-training Mean-Teacher for Unsupervised Domain Adaptation on 3D Object Detection

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

Contrastive Mean Teacher for Domain Adaptive Object Detectors

Remote Sensing Teacher: Cross-Domain Detection Transformer with Learnable Frequency-Enhanced Feature Alignment in Remote Sensing Imagery

Adversarial Attacked Teacher for Unsupervised Domain Adaptive Object Detection