Domain adaptation with feature and label adversarial networks

Peng Zhao,Wenhua Zang,Bin Liu,Zhao Kang,Kun Bai,Kaizhu Huang,Zenglin Xu
DOI: https://doi.org/10.1016/j.neucom.2021.01.062
IF: 6
2021-06-01
Neurocomputing
Abstract:<p>Learning a cross-domain representation from labeled source domains to unlabeled target domains is an important research problem in representation learning. Despite the success of traditional adversarial methods, they proposed to align features from each domain only while neglecting the importance of labels, when fooling a special domain discriminator network. Thus, the discriminator of these approaches merely distinguishes whether the generated features are in-domain or not, which may lead to less class-discriminative features. In this paper, by considering the joint distributions of features and labels in both domains, we present Feature and Label Adversarial Networks (FLAN). As a result, FLAN can generate more discriminative features in both domains. Experimental results on standard unsupervised domain adaptation benchmarks have demonstrated that FLAN can outperform the state-of-art domain invariant representation learning methods.</p>
computer science, artificial intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is in unsupervised domain adaptation, how to generate more discriminative features by simultaneously considering the joint distribution of features and labels, thereby reducing the data distribution difference between the source domain and the target domain. Traditional adversarial methods mainly focus on aligning the features of each domain while ignoring the importance of labels, which may lead to the generated features being not discriminative enough in classification. Therefore, this paper proposes Feature and Label Adversarial Networks (FLAN), aiming to improve the classification performance on the target domain by using the joint distribution information of features and labels. Specifically, the main contributions of FLAN include: 1. **Proposing a generative adversarial framework**: Directly learn the shared feature embedding while considering feature and label information. The key improvement is that the discriminator makes full use of feature and label information, so that rich information can be transmitted to the generator to learn more discriminative features. 2. **Exploring pseudo - labels of the target domain**: Although there is no labeled data in the target domain, by introducing entropy minimization, the classifier is encouraged to better fit the specific structure of the target domain, thereby generating high - quality pseudo - labels. 3. **Efficient end - to - end solution**: The entire framework can be efficiently solved by back - propagation. Experimental results show that FLAN outperforms the existing state - of - the - art algorithms on three domain - adaptation datasets. Through these improvements, FLAN can more effectively reduce the data distribution difference between the source domain and the target domain in unsupervised domain adaptation tasks, thereby improving the classification performance on the target domain.