Abstract:Domain adaptation allows knowledge from a source domain to be transferred to a different but related target domain. Intuitively, discovering a good feature representation across domains is crucial. In this paper, we first propose to find such a representation through a new learning method, transfer component analysis (TCA), for domain adaptation. TCA tries to learn some transfer components across domains in a reproducing kernel Hilbert space using maximum mean miscrepancy. In the subspace spanned by these transfer components, data properties are preserved and data distributions in different domains are close to each other. As a result, with the new representations in this subspace, we can apply standard machine learning methods to train classifiers or regression models in the source domain for use in the target domain. Furthermore, in order to uncover the knowledge hidden in the relations between the data labels from the source and target domains, we extend TCA in a semisupervised learning setting, which encodes label information into transfer components learning. We call this extension semisupervised TCA. The main contribution of our work is that we propose a novel dimensionality reduction framework for reducing the distance between domains in a latent space for domain adaptation. We propose both unsupervised and semisupervised feature extraction approaches, which can dramatically reduce the distance between domain distributions by projecting data onto the learned transfer components. Finally, our approach can handle large datasets and naturally lead to out-of-sample generalization. The effectiveness and efficiency of our approach are verified by experiments on five toy datasets and two real-world applications: cross-domain indoor WiFi localization and cross-domain text classification.

Transductive Component Analysis

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Locality sensitive discriminant transductive learning

Semisupervised Tangent Space Discriminant Analysis

Domain Adaptation via Transfer Component Analysis

Transferred Dimensionality Reduction

Subspace Learning Based on Tensor Analysis

Independent Component Analysis: Embedded LTSA

Local Tangent Space Discriminant Analysis.

Semi-Supervised Discriminant Analysis Via Spectral Transduction.

Local Feature Discriminant Projection

Orthogonal Component Analysis: A Fast Dimensionality Reduction Algorithm

Extracting the Optimal Dimensionality for Local Tensor Discriminant Analysis

Supervised Dimensionality Reduction Technology of Generalized Discriminant Component Analysis and Its Kernelization Forms

A Unified Framework for Semi-Supervised Dimensionality Reduction

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

An Evolutionary Orthogonal Component Analysis Method for Incremental Dimensionality Reduction.

Supervised Discriminative Sparse PCA with Adaptive Neighbors for Dimensionality Reduction

Reconstructable generalized maximum scatter difference discriminant analysis

Discriminative Vanishing Component Analysis

Semi-supervised double sparse graphs based discriminant analysis for dimensionality reduction