Abstract:Domain adversarial training has shown its effective capability for finding domain invariant feature representations and been successfully adopted for various domain adaptation tasks. However, recent advances of large models (e.g., vision transformers) and emerging of complex adaptation scenarios (e.g., DomainNet) make adversarial training being easily biased towards source domain and hardly adapted to target domain. The reason is twofold: relying on large amount of labelled data from source domain for large model training and lacking of labelled data from target domain for fine-tuning. Existing approaches widely focused on either enhancing discriminator or improving the training stability for the backbone networks. Due to unbalanced competition between the feature extractor and the discriminator during the adversarial training, existing solutions fail to function well on complex datasets. To address this issue, we proposed a novel contrastive adversarial training (CAT) approach that leverages the labeled source domain samples to reinforce and regulate the feature generation for target domain. Typically, the regulation forces the target feature distribution being similar to the source feature distribution. CAT addressed three major challenges in adversarial learning: 1) ensure the feature distributions from two domains as indistinguishable as possible for the discriminator, resulting in a more robust domain-invariant feature generation; 2) encourage target samples moving closer to the source in the feature space, reducing the requirement for generalizing classifier trained on the labeled source domain to unlabeled target domain; 3) avoid directly aligning unpaired source and target samples within mini-batch. CAT can be easily plugged into existing models and exhibits significant performance improvements.

CATIL: Customized Adversarial Training based on Instance Loss

CAT: Customized Adversarial Training for Improved Robustness

CAT: Collaborative Adversarial Training.

CAT:Collaborative Adversarial Training

GAAT: Group Adaptive Adversarial Training to Improve the Trade-Off Between Robustness and Accuracy

Improved Adversarial Training Through Adaptive Instance-wise Loss Smoothing

Case-Aware Adversarial Training

Class-aware domain adaptation for improving adversarial robustness

Contrastive Adversarial Training for Unsupervised Domain Adaptation

Boosting Adversarial Robustness Via Self-Paced Adversarial Training.

A Patch-wise Adversarial Denoising Could Enhance the Robustness of Adversarial Training

One radish, One hole: Specific adversarial training for enhancing neural network’s robustness

CFA: Class-wise Calibrated Fair Adversarial Training

ATAL: Active Learning Using Adversarial Training for Data Augmentation

Dynamic Label Adversarial Training for Deep Learning Robustness Against Adversarial Attacks

Minimizing Adversarial Training Samples for Robust Image Classifiers: Analysis and Adversarial Example Generator Design

Introducing Adaptive Continuous Adversarial Training (ACAT) to Enhance ML Robustness

Weighted Adaptive Perturbations Adversarial Training for Improving Robustness

Understanding Robust Overfitting of Adversarial Training and Beyond

ATRA: Efficient Adversarial Training with High-Robust Area

RDAT: an efficient regularized decoupled adversarial training mechanism