Abstract:Existing domain adaptation approaches often try to reduce distribution difference between source and target domains and respect domain-specific discriminative structures by some distribution [e.g., maximum mean discrepancy (MMD)] and discriminative distances (e.g., intra-class and inter-class distances). However, they usually consider these losses together and trade off their relative importance by estimating parameters empirically. It is still under insufficient exploration so far to deeply study their relationships to each other so that we cannot manipulate them correctly and the model’s performance degrades. To this end, this article theoretically proves two essential facts: 1) minimizing MMD equals to jointly minimizing their data variance with some implicit weights but, respectively, maximizing the source and target intra-class distances so that feature discriminability degrades and 2) the relationship between intra-class and inter-class distances is as one falls and another rises. Based on this, we propose a novel discriminative MMD with two parallel strategies to correctly restrain the degradation of feature discriminability or the expansion of intra-class distance; specifically: 1) we directly impose a tradeoff parameter on the intra-class distance that is implicit in the MMD according to 1) and 2) we reformulate the inter-class distance with special weights that are analogical to those implicit ones in the MMD and maximizing it can also lead to the intra-class distance falling according to 2). Notably, we do not consider the two strategies in one model due to 2). The experiments on several benchmark datasets not only prove the validity of our revealed theoretical results but also demonstrate that the proposed approach could perform better than some compared state-of-art methods substantially. Our preliminary MATLAB code will be available at https://github.com/WWLoveTransfer/ .

A Unified Joint Maximum Mean Discrepancy for Domain Adaptation

Discriminative Joint Probability Maximum Mean Discrepancy (DJP-MMD) for Domain Adaptation

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Domain Adaptation Based on the Measure of Kernel-Product Maximum Mean Discrepancy.

HOMDA: High-Order Moment-Based Domain Alignment for Unsupervised Domain Adaptation

Maximum Mean and Covariance Discrepancy for Unsupervised Domain Adaptation.

Improving Maximum Classifier Discrepancy by Considering Joint Distribution for Domain Adaptation

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Joint Distribution Matching Embedding for Unsupervised Domain Adaptation

Rethink Maximum Mean Discrepancy for Domain Adaptation

A Unified Weighted MMD for Unsupervised Domain Adaptation

Rethinking Maximum Mean Discrepancy for Visual Domain Adaptation

Joint Metric and Feature Representation Learning for Unsupervised Domain Adaptation

Semi-Supervised Domain Adaptation Via Asymmetric Joint Distribution Matching

Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation.

Domain Adaptation by Joint Distribution Invariant Projections.

Unsupervised Domain Adaptation with Unified Joint Distribution Alignment

Towards Discriminability with Distribution Discrepancy Constrains for Multisource Domain Adaptation

C V ] 1 M ay 2 01 7 Mind the Class Weight Bias : Weighted MaximumMean Discrepancy for Unsupervised Domain Adaptation

Deep Domain Adaptation Based on Multi-layer Joint Kernelized Distance.

Cross-species Data Classification by Domain Adaptation via Discriminative Heterogeneous Maximum Mean Discrepancy