Matching Attention Network For Domain Adaptation Optimized By Joint Gans And Kl-Mmd

Yuan-Zhu Gan,Hai-Qing Wang,Lu-Fei Liu,Yu-Bin Yang
DOI: https://doi.org/10.1007/978-3-319-97304-3_26
2018-01-01
Abstract:Although deep neural networks have brought impressive advances in a variety of machine learning tasks, it is more difficult to train a top-performing model in the absence of the labeled data. To alleviate this issue, domain adaptation has been extensively researched, which aims to reduce the difference between the distributions of the source and target domain by imposing restrictions on features. Adversarial learning method is the most promising approach to generate data that obeys a complex distribution. However, generator model often sinks into partial or full collapse. In this paper, we transform the complex data into a simple distribution, then calculate KL divergence (KL-MMD). We combine the Matching Gate with Attention Mechanism and put forward Matching Attention to learn feature vectors. Extensive experiments and analysis are conducted on three different digits datasets: MNIST, USPS, SVHN. To our knowledge, our method achieves state-of-the-art digit recognition performance on three unsupervised adaptation results.
What problem does this paper attempt to address?