Abstract:In numerous real-world applications, obtaining labeled data for a specific deep learning task can be prohibitively expensive. We present an innovative framework for unsupervised training of deep neural networks, drawing inspiration from the adversarial learning paradigm. Our approach incorporates the cycle-consistency constraint to effectively constrain the generator. Furthermore, we capitalize on the reconstructed samples, treating them as "real" samples for the discriminator during classification. This idea stems from the success of Wasserstein GAN, which leverages its gradient property and promising generalization bound during network training. Simultaneously, we employ a shared latent-data space constraint to ensure compatibility between the source domain and its corresponding target domain. This constraint facilitates effective knowledge transfer from the source to the target domain, even in the absence of labeled data for the target domain. To enhance the performance of the target domain classifier, we introduce association chains that link the embeddings of labeled samples to those of unlabeled samples and vice versa. By encouraging correct association cycles that ultimately return to the same class from which the association began, and penalizing wrong associations leading to a different class, we ensure accurate predictions. Our proposed method, named Shared Wasserstein Adversarial Domain Learning (SWADL), combines these novel constraints. Through extensive evaluations on benchmark datasets such as MNIST, SVHN, and USPS, we demonstrate that SWADL consistently outperforms current mainstream methods. It achieves superior results in unsupervised domain adaptation tasks, addressing the challenge of limited labeled data in real-world scenarios. The code and models are available at https://github.com/Jayee-chen/Adversarial-Domain-Adaptation.git.

Unsupervised Domain Adaptation for Grade Prediction of Froth Flotation Based on Wasserstein Distance and Transformer

A Novel Transfer Learning Method for Robot Bearing Fault Diagnosis Based on Deep Convolutional Residual Wasserstein Adversarial Network.

Study on Prediction of Zinc Grade by Transformer Model with De-Stationary Mechanism

Deep Ensemble Learning-Based Sensor for Flotation Froth Image Recognition

Deep Asymmetric Transfer Network For Unbalanced Domain Adaptation

A Two-Stage Multi-Target Domain Adaptation Framework for Prediction of Key Performance Indicators Based on Adversarial Network

Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data

Towards Unsupervised Domain Adaptation via Domain-Transformer

Wasserstein Distance-Weighted Adversarial Network for Cross-Domain Credit Risk Assessment

A Simple Baseline for Adversarial Domain Adaptation-based Unsupervised Flood Forecasting

Shared wasserstein adversarial domain adaption

Supervised Domain Adaptation for Remaining Useful Life Prediction Based on AdaBoost With Long Short-Term Memory

Domain Perceptive-Pruning and Fine-Tuning the Pre-Trained Model for Heterogeneous Transfer Learning in Cross Domain Prediction

Making the Best of Both Worlds: A Domain-Oriented Transformer for Unsupervised Domain Adaptation

Cross-Domain Remaining Useful Life Prediction Based on Adversarial Training

Extrapolability Improvement of Machine Learning-Based Evapotranspiration Models via Domain-Adversarial Neural Networks

An unsupervised dual-regression domain adversarial adaption network for tool wear prediction in multi-working conditions

Prediction Reweighting for Domain Adaptation

Pre-training enhanced unsupervised contrastive domain adaptation for industrial equipment remaining useful life prediction

Decomposed-distance weighted optimal transport for unsupervised domain adaptation

Wasserstein Distance based Deep Adversarial Transfer Learning for Intelligent Fault Diagnosis