Abstract:Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global statistics alignment, such as the Maximum Mean Discrepancy (MMD) which matches the Mean statistics across domains. The lack of class information, however, may lead to partial alignment (or even misalignment) and poor generalization performance. For robust domain alignment, we argue that the similarities across different features in the source domain should be consistent with that in the target domain. Based on this assumption, we propose a new domain discrepancy metric, i.e., Self-similarity Consistency (SSC), to enforce the pairwise relationship between different features being consistent across domains. The Gram matrix matching and Correlation Alignment is proven to be a special case, and a sub-optimal measure of our proposed SSC. Furthermore, we also propose to mitigate the side effect of the partial alignment and misalignment by incorporating the discriminative information of the deep representations. Specifically, a simple yet effective feature norm constraint is exploited to enlarge the discrepancy of inter-class samples. It relieves the requirements of strict alignment when performing adaptation, therefore improving the adaptation performance significantly. Extensive experiments on visual domain adaptation tasks demonstrate the effectiveness of our proposed SSC metric and feature discrimination approach.

Investigation on Adaptation Using Different Discriminative Training Criteria Based Linear Regression and Map

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

A Discriminative Linear Regression Approach to OCR Adaptation

A Discriminative Linear Regression Approach to Adaptation of Multi-Prototype Based Classifiers and Its Applications for Chinese OCR.

Discriminative Language Model Adaptation for Mandarin Broadcast Speech Transcription and Translation

Unsupervised Discriminative Adaptation Using Discriminative Mapping Transforms

Unsupervised Adaptation with Discriminative Mapping Transforms.

Eigenvoice-based MAP Adaptation Within Correlation Subspace

Improvement Comparison of Different Lattice-based Discriminative Training Methods in Chinese-monolingual and Chinese-English-bilingual Speech Recognition

Speaker Adaptation with MAP Estimation and Weighted Neighbor Regression

A Language Model Adaptation Approach Based on Text Classification.

An Active Learning Approach to Task Adaptation.

Speaker Adaptation with Transformation Matrix Linear Interpolation

Speaker adaptation based on combination of MAP estimation and weighted neighbor regression

A Comparative Study of RPCL and MCE Based Discriminative Training Methods for LVCSR.

Maximum A Posteriori Linear Regression for Language Recognition.

Adaptive Training Using Discriminative Mapping Transforms

Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs

Comparison of adaptation methods for GMM-SVM based speech emotion recognition

The Distance Field Model And Distance Constrained Map Adaptation Algorithm

A Study and Improvement of Minimum Sample Risk Methods for Language Modeling