Abstract:Black-box domain adaptation treats the source domain model as a black box. During the transfer process, the only available information about the target domain is the noisy labels output by the black-box model. This poses significant challenges for domain adaptation. Conventional approaches typically tackle the black-box noisy label problem from two aspects: self-knowledge distillation and pseudo-label denoising, both achieving limited performance due to limited knowledge information. To mitigate this issue, we explore the potential of off-the-shelf vision-language (ViL) multimodal models with rich semantic information for black-box domain adaptation by introducing an Adversarial Experts Model (AEM). Specifically, our target domain model is designed as one feature extractor and two classifiers, trained over two stages: In the knowledge transferring stage, with a shared feature extractor, the black-box source model and the ViL model act as two distinct experts for joint knowledge contribution, guiding the learning of one classifier each. While contributing their respective knowledge, the experts are also updated due to their own limitation and bias. In the adversarial alignment stage, to further distill expert knowledge to the target domain model, adversarial learning is conducted between the feature extractor and the two classifiers. A new consistency-max loss function is proposed to measure two classifier consistency and further improve classifier prediction certainty. Extensive experiments on multiple datasets demonstrate the effectiveness of our approach. Code is available at https://github.com/singinger/AEM.

Adversarial Training for Uncertainty Estimation in Cross-Lingual Text Classification

Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation

Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding

Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation

Adversarial Neural Networks for Cross-lingual Sequence Tagging

Adversarial Training for Unsupervised Bilingual Lexicon Induction

Unsupervised Cross-Domain Adaptation for Response Selection Using Self-Supervised and Adversarial Training

ATHG: Adversarial Training with Heterogeneous Graph to Enhance Cross-Lingual Text Classification

Uncertainty-aware Self-training for Low-resource Neural Sequence Labeling

Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets

Adversarial Training for Unknown Word Problems in Neural Machine Translation

Robust Remote Sensing Scene Classification by Adversarial Self-Supervised Learning

MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Training

Adversarial Experts Model for Black-box Domain Adaptation

Adversarial Cross-Lingual Transfer Learning for Slot Tagging of Low-Resource Languages

Adversarial Training for Large Neural Language Models

Uncertainty-Aware Model Adaptation for Unsupervised Cross-Domain Object Detection

AdvPicker: Effectively Leveraging Unlabeled Data Via Adversarial Discriminator for Cross-Lingual NER

Unsupervised cross-domain named entity recognition using entity-aware adversarial training

Feature Alignment by Uncertainty and Self-Training for Source-Free Unsupervised Domain Adaptation