Abstract:Domain adaptation (DA) aims to enable a learning model trained from a source domain to generalize well on a target domain, despite the mismatch of data distributions between the two domains. State-of-the-art DA methods have so far focused on the search of a latent shared feature space where source and target domain data can be aligned either statistically and/or geometrically. In this paper, we propose a novel unsupervised DA method, namely Discriminative Noise Robust Sparse Orthogonal Label Regression-based Domain Adaptation (DOLL-DA). The proposed DOLL-DA derives from a novel integrated model which searches a shared feature subspace where data labels are orthogonally regressed using a label embedding trick, and source and target domain data are discriminatively aligned statistically through optimization of some repulse force terms. Furthermore, in minimizing a novel Noise Robust Sparse Orthogonal Label Regression(NRS_OLR) term, the proposed model explicitly accounts for data outliers to avoid negative transfer and introduces the property of sparsity when regressing data labels. We carry out comprehensive experiments in comparison with 35 state of the art DA methods using 8 standard DA benchmarks and 49 cross-domain image classification tasks. The proposed DA method demonstrates its effectiveness and consistently outperforms the state-of-the-art DA methods with a margin which reaches 17 points on the CMU PIE dataset. To gain insight into the proposed DOLL-DA, we also derive three additional DA methods based on three partial models from the full model, namely OLR, CDDA+, and JOLR-DA, highlighting the added value of (1) discriminative statistical data alignment; (2) Noise Robust Sparse Orthogonal Label Regression; and (3) their joint optimization through the full DA model. In addition, we also perform time complexity and an in-depth empiric analysis of the proposed DA method in terms of its sensitivity w.r.t. hyper-parameters, convergence speed, impact of the base classifier and random label initialization as well as performance stability w.r.t. target domain data being used in training.

Label Disentangled Analysis for unsupervised visual domain adaptation

Federated Domain Adaptation via Pseudo-label Refinement

Domain Adaptation for Label Distribution Learning

Source-free Domain Adaptation Via Dynamic Pseudo Labeling and Self-supervision

GLA-DA: Global-Local Alignment Domain Adaptation for Multivariate Time Series

IDPL: Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels

Unsupervised domain adaptation with weak source domain labels via bidirectional subdomain alignment

Learning Feature Decomposition for Domain Adaptive Monocular Depth Estimation

Discriminative Noise Robust Sparse Orthogonal Label Regression-Based Domain Adaptation

Unsupervised Domain Adaptation in the Wild via Disentangling Representation Learning

Domain-Augmented Domain Adaptation

Unsupervised Domain Adaptation for Medical Image Segmentation by Disentanglement Learning and Self-Training

Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Informative Feature Disentanglement for Unsupervised Domain Adaptation

Multiview Latent Space Learning with Progressively Fine-tuned Deep Features for Unsupervised Domain Adaptation

Generation, division and training: A promising method for source-free unsupervised domain adaptation

Mutual-weighted feature disentanglement for unsupervised domain adaptation

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

DiDA: Disentangled Synthesis for Domain Adaptation

Learning From a Complementary-Label Source Domain: Theory and Algorithms