Abstract:Unsupervised domain adaptation (UDA) aims to transfer a model learned using labeled data from the source domain to unlabeled data in the target domain. To address the large domain gap issue between the source and target domains, we propose a novel regularization method for domain adaptive object detection, BlenDA, by generating the pseudo samples of the intermediate domains and their corresponding soft domain labels for adaptation training. The intermediate samples are generated by dynamically blending the source images with their corresponding translated images using an off-the-shelf pre-trained text-to-image diffusion model which takes the text label of the target domain as input and has demonstrated superior image-to-image translation quality. Based on experimental results from two adaptation benchmarks, our proposed approach can significantly enhance the performance of the state-of-the-art domain adaptive object detector, Adversarial Query Transformer (AQT). Particularly, in the Cityscapes to Foggy Cityscapes adaptation, we achieve an impressive 53.4% mAP on the Foggy Cityscapes dataset, surpassing the previous state-of-the-art by 1.5%. It is worth noting that our proposed method is also applicable to various paradigms of domain adaptive object detection. The code is available at:

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to reduce the domain gap between the source domain and the target domain in Unsupervised Domain Adaptation (UDA) in order to improve the performance of the target detection model on unlabeled target - domain data. Specifically, the authors propose a new regularization method - BlenDA (Object Detection for Domain Adaptation via Blended Images Generated by Diffusion), which trains the model by generating pseudo - samples of the intermediate domain and their corresponding soft - domain labels, thereby enhancing the model's adaptability to the target domain. ### Main contributions: 1. **Generate intermediate - domain samples**: Utilize a pre - trained text - to - image - based diffusion model (such as InstructPix2Pix) to generate translation images in the target - domain style according to the text labels of the target domain, and dynamically mix them with the source - domain images to generate intermediate - domain samples. 2. **Dynamically adjust the mixing weights**: Propose a method for dynamically adjusting the mixing weights. As the training iteration progresses, gradually increase the proportion of target - domain information to avoid over - fitting the model to the intermediate - domain samples. 3. **Mixed - domain adversarial loss**: Introduce a mixed - domain adversarial loss, and use soft - domain labels (i.e., mixing weights) to enhance the discriminator's ability to distinguish different domains. ### Experimental results: - **Cityscapes to Foggy Cityscapes**: On the Foggy Cityscapes dataset, BlenDA improves AQT's mAP from 47.1% to 53.4%, surpassing the previous state - of - the - art method by 1.5%. - **Cityscapes to BDD100K daytime**: On the BDD100K daytime dataset, BlenDA improves AQT's mAP from 29.4% to 33.5%, an increase of 4.1%. ### Conclusion: BlenDA effectively reduces the domain gap between the source domain and the target domain by generating high - quality intermediate - domain samples and dynamically adjusting the mixing weights, significantly improving the performance of the target detection model on the target domain. This method is not only applicable to AQT, but can also be applied to other domain - adaptation target - detection frameworks.

BlenDA: Domain Adaptive Object Detection through diffusion-based blending

GrabDAE: An Innovative Framework for Unsupervised Domain Adaptation Utilizing Grab-Mask and Denoise Auto-Encoder

Unsupervised Domain Adaptation via Domain-Adaptive Diffusion

Diffuse-UDA: Addressing Unsupervised Domain Adaptation in Medical Image Segmentation with Appearance and Structure Aligned Diffusion Models

Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detection

Domain-Augmented Domain Adaptation

Joint Distribution Alignment via Adversarial Learning for Domain Adaptive Object Detection

Progressive Domain Adaptation for Object Detection

Dynamic bias alignment and discrimination enhancement for unsupervised domain adaptation

DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object Detection

Density-Insensitive Unsupervised Domain Adaption on 3D Object Detection

Domain Adaptation for Underwater Image Enhancement

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

Unsupervised Domain Adaptation for Object Detection via Cross-Domain Semi-Supervised Learning

Domain-Guided Conditional Diffusion Model for Unsupervised Domain Adaptation

Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection

AWADA: Foreground-focused adversarial learning for cross-domain object detection

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation

ControlUDA: Controllable Diffusion-assisted Unsupervised Domain Adaptation for Cross-Weather Semantic Segmentation

Unsupervised Domain Adaptation for Video Object Grounding with Cascaded Debiasing Learning

AdaptDiff: Cross-Modality Domain Adaptation via Weak Conditional Semantic Diffusion for Retinal Vessel Segmentation