Abstract:Domain adaptation (DA) aims to enable a learning model trained from a source domain to generalize well on a target domain, despite the mismatch of data distributions between the two domains. State-of-the-art DA methods have so far focused on the search of a latent shared feature space where source and target domain data can be aligned either statistically and/or geometrically. In this paper, we propose a novel unsupervised DA method, namely Discriminative Noise Robust Sparse Orthogonal Label Regression-based Domain Adaptation (DOLL-DA). The proposed DOLL-DA derives from a novel integrated model which searches a shared feature subspace where data labels are orthogonally regressed using a label embedding trick, and source and target domain data are discriminatively aligned statistically through optimization of some repulse force terms. Furthermore, in minimizing a novel Noise Robust Sparse Orthogonal Label Regression(NRS_OLR) term, the proposed model explicitly accounts for data outliers to avoid negative transfer and introduces the property of sparsity when regressing data labels. We carry out comprehensive experiments in comparison with 35 state of the art DA methods using 8 standard DA benchmarks and 49 cross-domain image classification tasks. The proposed DA method demonstrates its effectiveness and consistently outperforms the state-of-the-art DA methods with a margin which reaches 17 points on the CMU PIE dataset. To gain insight into the proposed DOLL-DA, we also derive three additional DA methods based on three partial models from the full model, namely OLR, CDDA+, and JOLR-DA, highlighting the added value of (1) discriminative statistical data alignment; (2) Noise Robust Sparse Orthogonal Label Regression; and (3) their joint optimization through the full DA model. In addition, we also perform time complexity and an in-depth empiric analysis of the proposed DA method in terms of its sensitivity w.r.t. hyper-parameters, convergence speed, impact of the base classifier and random label initialization as well as performance stability w.r.t. target domain data being used in training.

Unsupervised Domain Adaptation With Robust Deep Logistic Regression

Robust Deep Softmax Regression Against Label Noise for Unsupervised Domain Adaptation.

Reliable Domain Adaptation With Classifiers Competition

Unsupervised Domain Adaptation Using Robust Class-Wise Matching

Deep Ladder-Suppression Network for Unsupervised Domain Adaptation

Reliable Domain Adaptation With Classifiers Competition For Image Classification

Finding Robust Transfer Features for Unsupervised Domain Adaptation.

Unsupervised Domain Adaptation via Domain-Adaptive Diffusion

Learning Transferable and Discriminative Features for Unsupervised Domain Adaptation

Deep residual LSTM with domain-invariance for remaining useful life prediction across domains

Deep Unsupervised Convolutional Domain Adaptation

Class Discriminative Adversarial Learning for Unsupervised Domain Adaptation

Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation

Enhancing Unsupervised Domain Adaptation by Discriminative Relevance Regularization

Balancing Transferability and Discriminability for Unsupervised Domain Adaptation.

Predictive Modeling With an Adaptive Unsupervised Broad Transfer Algorithm

Unsupervised domain adaptation with weak source domain labels via bidirectional subdomain alignment

Adversarial Unsupervised Domain Adaptation Via Real Data Augmentation and Uncertainty Penalization

Dual Mixup Regularized Learning for Adversarial Domain Adaptation

Unsupervised Domain Adaptation Via Risk-Consistent Estimators

Discriminative Noise Robust Sparse Orthogonal Label Regression-Based Domain Adaptation