Abstract:Domain adversarial training has shown its effective capability for finding domain invariant feature representations and been successfully adopted for various domain adaptation tasks. However, recent advances of large models (e.g., vision transformers) and emerging of complex adaptation scenarios (e.g., DomainNet) make adversarial training being easily biased towards source domain and hardly adapted to target domain. The reason is twofold: relying on large amount of labelled data from source domain for large model training and lacking of labelled data from target domain for fine-tuning. Existing approaches widely focused on either enhancing discriminator or improving the training stability for the backbone networks. Due to unbalanced competition between the feature extractor and the discriminator during the adversarial training, existing solutions fail to function well on complex datasets. To address this issue, we proposed a novel contrastive adversarial training (CAT) approach that leverages the labeled source domain samples to reinforce and regulate the feature generation for target domain. Typically, the regulation forces the target feature distribution being similar to the source feature distribution. CAT addressed three major challenges in adversarial learning: 1) ensure the feature distributions from two domains as indistinguishable as possible for the discriminator, resulting in a more robust domain-invariant feature generation; 2) encourage target samples moving closer to the source in the feature space, reducing the requirement for generalizing classifier trained on the labeled source domain to unlabeled target domain; 3) avoid directly aligning unpaired source and target samples within mini-batch. CAT can be easily plugged into existing models and exhibits significant performance improvements.

Adversarial Self-Supervised Learning for Out-of-Domain Detection.

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

KNN-Contrastive Learning for Out-of-Domain Intent Classification

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training

Out-of-domain Detection for Natural Language Understanding in Dialog Systems

OOD Aware Supervised Contrastive Learning

CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learning

Estimating Soft Labels for Out-of-Domain Intent Detection

Towards the Out-of-Distribution Generalization of Contrastive Self-Supervised Learning

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Dual-Adapter: Training-free Dual Adaptation for Few-shot Out-of-Distribution Detection

APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contexts

Understanding the Role of Self-Supervised Learning in Out-of-Distribution Detection Task

Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detection

Contrastive Adversarial Training for Unsupervised Domain Adaptation

Self-Supervised Representation Learning for Adversarial Attack Detection

A Self-supervised Adversarial Learning Approach for Network Intrusion Detection System.

Safe Semi-Supervised Contrastive Learning Using In-Distribution Data as Positive Examples

Adversarial Supervised Contrastive Learning

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery