Abstract:Unsupervised domain adaptation (UDA) trains models using labeled data from a specific source domain and then transferring the knowledge to certain target domains that have few or no labels. Many prior measurement-based works achieve lots of progress, but their feature distinguishing abilities to classify target samples with similar features are not enough; they do not adequately consider the confusing samples in the target domain that are similar to the source domain; and they don't consider negative transfer of the outlier sample in source domain. We address these issues in our work and propose an UDA method with asymmetrical margin disparity loss and outlier sample extraction, called AMD-Net with OSE. We propose an Asymmetrical Margin Disparity Discrepancy (AMD) method and a training strategy based on sample selection mechanism to make the network have better feature extraction ability and the network gets rid of local optimal. Firstly, in the AMD method, we design a multi-label entropy metric to evaluate the marginal disparity loss of the confusing samples in the target domain. This asymmetric marginal disparity loss designment uses the different entropy measurement algorithms of the two domains to excavate the differences of the two domains as much as possible, so as to find the common features of the two domains. Secondly, A sample selection mechanism is designed to evaluate which part of the sample in target domain is confusable. We define the certainty of the sample in the target domain, adopt a progressive learning scheme, and adopt one-hot marginal disparity loss for most of the samples in the target domain with low uncertainty and easy to distinguish. The multi-label marginal calculation method is used only for the uncertainty samples in the target domain whose certainty is less than the threshold value, so that the network can get rid of the local optimal as much as possible. At last, we further propose an outlier sample extraction algorithm (OSE) based on weighted cosine similarity distance for source domain to reduce the negative migration effect caused by outlier samples in the source domain. Extensive experiments on four datasets Office-31, Office-Home, VisDA-2017 and DomainNet demonstrate that our method works well in various UDA settings and outperforms the state-of-the-art methods.

Maximum open-set entropy optimization via uncertainty measure for universal domain adaptation

Uncertainty-guided Joint Unbalanced Optimal Transport for Unsupervised Domain Adaptation

Learning to Detect Open Classes for Universal Domain Adaptation

HOMDA: High-Order Moment-Based Domain Alignment for Unsupervised Domain Adaptation

Unified Entropy Optimization for Open-Set Test-Time Adaptation

Adversarial Entropy Optimization for Unsupervised Domain Adaptation

Open Set Domain Adaptation: Theoretical Bound and Algorithm

Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling

Entropy Minimization vs. Diversity Maximization for Domain Adaptation

Geometric Anchor Correspondence Mining with Uncertainty Modeling for Universal Domain Adaptation

Dirichlet-based Uncertainty Calibration for Active Domain Adaptation

Imbalanced Open Set Domain Adaptation via Moving-threshold Estimation and Gradual Alignment

Revisiting the Domain Shift and Sample Uncertainty in Multi-source Active Domain Transfer

Bridging the Theoretical Bound and Deep Algorithms for Open Set Domain Adaptation

Unified Optimal Transport Framework for Universal Domain Adaptation

Maximizing conditional independence for unsupervised domain adaptation

Dual Contrastive Universal Adaptation Network.

Uncertainty-guided Open-Set Source-Free Unsupervised Domain Adaptation with Target-private Class Segregation

Unsupervised Domain Adaptation with Asymmetrical Margin Disparity loss and Outlier Sample Extraction

Open Set Domain Adaptation With Soft Unknown-Class Rejection

Uncertainty-Aware Unsupervised Domain Adaptation in Object Detection