Abstract:Deep learning has made a tremendous impact on various applications in multimedia, such as media interpretation and multimodal retrieval. However, deep learning models usually require a large amount of labeled data to achieve satisfactory performance. In multimedia analysis, domain adaptation studies the problem of cross-domain knowledge transfer from a label rich source domain to a label scarce target domain, thus potentially alleviates the annotation requirement for deep learning models. However, we find that contemporary domain adaptation methods for cross-domain image understanding perform poorly when source domain is noisy. Weakly Supervised Domain Adaptation (WSDA) studies the domain adaptation problem under the scenario where source data can be noisy. Prior methods on WSDA remove noisy source data and align the marginal distribution across domains without considering the fine-grained semantic structure in the embedding space, which have the problem of class misalignment, e.g., features of cats in the target domain might be mapped near features of dogs in the source domain. In this paper, we propose a novel method, termed Noise Tolerant Domain Adaptation (NTDA), for WSDA. Specifically, we adopt the cluster assumption and learn cluster discriminatively with class prototypes (centroids) in the embedding space. We propose to leverage the location information of the data points in the embedding space and model the location information with a Gaussian mixture model to identify noisy source data. We then design a network which incorporates the Gaussian mixture noise model as a sub-module for unsupervised noise removal and propose a novel cluster-level adversarial adaptation method based on the Generative Adversarial Network (GAN) framework which aligns unlabeled target data with the less noisy class prototypes for mapping the semantic structure across domains. Finally, we devise a simple and effective algorithm to train the network from end to end. We conduct extensive experiments to evaluate the effectiveness of our method on both general images and medical images from COVID-19 and e-commerce datasets. The results show that our method significantly outperforms state-of-the-art WSDA methods.

ROAD: Robust Unsupervised Domain Adaptation with Noisy Labels

Federated Domain Adaptation via Pseudo-label Refinement

Robust Local Preserving and Global Aligning Network for Adversarial Domain Adaptation

Robust Deep Softmax Regression Against Label Noise for Unsupervised Domain Adaptation.

Unsupervised Domain Adaptation With Robust Deep Logistic Regression

Reliable Domain Adaptation With Classifiers Competition

Unsupervised Domain Adaptation Via Risk-Consistent Estimators

Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training for Road Segmentation of Remote Sensing Images

Towards Trustworthy Unsupervised Domain Adaptation: A Representation Learning Perspective for Enhancing Robustness, Discrimination, and Generalization

Generative Model Based Noise Robust Training for Unsupervised Domain Adaptation

Source-free Domain Adaptation Via Dynamic Pseudo Labeling and Self-supervision

SRoUDA: Meta Self-training for Robust Unsupervised Domain Adaptation

Unsupervised Multi-Source Domain Adaptation for Pedestrian Re-identification ??A Study in Noise-Resilient Learning

Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation

Towards Robust Cross-domain Image Understanding with Unsupervised Noise Removal

DRIVE: Dual-Robustness via Information Variability and Entropic Consistency in Source-Free Unsupervised Domain Adaptation

Adversarial Unsupervised Domain Adaptation Via Real Data Augmentation and Uncertainty Penalization

Unsupervised domain adaptation with weak source domain labels via bidirectional subdomain alignment

Robust Self-Supervised Learning for Source-Free Domain Adaptation

Self-Supervised Noisy Label Learning for Source-Free Unsupervised Domain Adaptation.

Uncertainty Estimation Pseudo-Labels Guided Source-Free Domain Adaptation for Cross-Domain Remaining Useful Life Prediction in IIoT