Abstract:Domain adaptation (DA) is one of the most promising techniques for leveraging existing knowledge from a source domain and applying it to a related target domain. Most DA methods mainly focus on learning a common subspace for the two domains by exploiting either the statistical property or the geometric structure independently to reduce the domain distribution difference. However, these two properties are complementary to each other, and jointly exploring them could yield optimal results. Inspired by the theoretical results of DA, in this paper, we propose structure preservation and distribution alignment (SPDA) in discriminative transfer subspace learning, which embeds the source domain classification error and reduction and domain distribution alignment into a single framework for optimization. SPDA learns an appropriate projection matrix, by which (1) the source domain classification error can be reduced; and (2) the source and target domain data are projected into a common subspace, where the domain distributions are well aligned and each target datum can be linearly reconstructed using the data from the source domain. To reduce the source domain classification error, an ε-dragging technique that relaxes the strict binary label matrix is introduced to enlarge the distance between two data points from different classes. Further, the global subspace structure and the local geometric structure are preserved by imposing a low-rank constraint and a sparse constraint, respectively, on the reconstruction coefficient matrix. Moreover, the space relationship of the samples is preserved using a graph regularization method. In addition, marginal and conditional distributions between the domains are minimized to further reduce the domain shift statistically. We formulate source domain classifier design, geometric structure preservation, and distribution alignment as a rank-minimization problem, and we design an effective optimization algorithm based on the alternating direction method of multipliers (ADMM) to solve this problem. The functions and roles of each term in this framework are analyzed. The results of extensive experiments conducted on five datasets show that SPDA outperforms several state-of-the-art approaches and exhibits classification performance comparable with that of modern deep DA methods.

Semi-supervised Domain Adaptation Via Subspace Exploration

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

Semi-supervised Domain Adaptation with Subspace Learning for Visual Recognition

Unsupervised Domain Adaptation With Joint Supervised Sparse Coding And Discriminative Regularization Term

Semi-supervised Domain Adaptation via Joint Transductive and Inductive Subspace Learning

Learning Disentangled Semantic Representation for Domain Adaptation

Semi-Supervised Domain Adaptation via Adaptive and Progressive Feature Alignment

Iterative Landmark Selection and Subspace Alignment for Unsupervised Domain Adaptation

Deep joint subdomain alignment for unsupervised domain adaptation

A Multi-View Consistency Framework with Semi-Supervised Domain Adaptation

Structure preservation and distribution alignment in discriminative transfer subspace learning

Semi-supervised Domain Adaptation for Semantic Segmentation

Inter-Domain Mixup for Semi-Supervised Domain Adaptation

Unsupervised Domain Adaptation in the Wild via Disentangling Representation Learning

Domain Adaptation for Remote Sensing Image Semantic Segmentation: An Integrated Approach of Contrastive Learning and Adversarial Learning

Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation Using Region and Category Adaptive Domain Discriminator

Unsupervised domain adaptation with weak source domain labels via bidirectional subdomain alignment

Multiview Latent Space Learning with Progressively Fine-tuned Deep Features for Unsupervised Domain Adaptation

Discriminative Label Consistent Domain Adaptation