Abstract:We investigate a practical domain adaptation task, called source-free domain adaptation (SFUDA), where the source-pretrained model is adapted to the target domain without access to the source data. Existing techniques mainly leverage self-supervised pseudo labeling to achieve class-wise global alignment [1] or rely on local structure extraction that encourages feature consistency among neighborhoods [2]. While impressive progress has been made, both lines of methods have their own drawbacks - the "global" approach is sensitive to noisy labels while the "local" counterpart suffers from source bias. In this paper, we present Divide and Contrast (DaC), a new paradigm for SFUDA that strives to connect the good ends of both worlds while bypassing their limitations. Based on the prediction confidence of the source model, DaC divides the target data into source-like and target-specific samples, where either group of samples is treated with tailored goals under an adaptive contrastive learning framework. Specifically, the source-like samples are utilized for learning global class clustering thanks to their relatively clean labels. The more noisy target-specific data are harnessed at the instance level for learning the intrinsic local structures. We further align the source-like domain with the target-specific samples using a memory bank-based Maximum Mean Discrepancy (MMD) loss to reduce the distribution mismatch. Extensive experiments on VisDA, Office-Home, and the more challenging DomainNet have verified the superior performance of DaC over current state-of-the-art approaches. The code is available at <a class="link-external link-https" href="https://github.com/ZyeZhang/DaC.git" rel="external noopener nofollow">this https URL</a>.

Multi-source-free Domain Adaptive Object Detection

Multi-View Domain Adaptive Object Detection on Camera Networks.

Target-Discriminability-Induced Multi-Source-Free Domain Adaptation

Transformer-Based Multi-Source Domain Adaptation Without Source Data.

Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning

Multi-source Distilling Domain Adaptation

DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object Detection

A Free Lunch for Unsupervised Domain Adaptive Object Detection without Source Data

Refined Pseudo Labeling for Source-Free Domain Adaptive Object Detection

Source-free domain adaptive object detection based on pseudo-supervised mean teacher

Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Survey

Source-free Domain Adaptive Object Detection in Remote Sensing Images

Frequency Spectrum Augmentation Consistency for Domain Adaptive Object Detection

Improving Online Source-free Domain Adaptation for Object Detection by Unsupervised Data Acquisition

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning

Reliable hybrid knowledge distillation for multi-source domain adaptive object detection

SSDA-YOLO: Semi-supervised domain adaptive YOLO for cross-domain object detection

Source-Free Domain Adaptation for YOLO Object Detection

More is Better: Deep Domain Adaptation with Multiple Sources

Source-Free Domain Adaptation Via Distribution Estimation