Abstract:Unsupervised domain adaptation (UDA) is a critical problem for transfer learning, which aims to transfer the semantic information from labeled source domain to unlabeled target domain. Recent advancements in UDA models have demonstrated significant generalization capabilities on the target domain. However, the generalization boundary of UDA models remains unclear. When the domain discrepancy is too large, the model can not preserve the distribution structure, leading to distribution collapse during the alignment. To address this challenge, we propose an efficient UDA framework named Gradually Vanishing Gap in Prototypical Network (GVG-PN), which achieves transfer learning from both global and local perspectives. From the global alignment standpoint, our model generates a domain-biased intermediate domain that helps preserve the distribution structures. By entangling cross-domain features, our model progressively reduces the risk of distribution collapse. However, only relying on global alignment is insufficient to preserve the distribution structure. To further enhance the inner relationships of features, we introduce the local perspective. We utilize the graph convolutional network (GCN) as an intuitive method to explore the internal relationships between features, ensuring the preservation of manifold structures and generating domain-biased prototypes. Additionally, we consider the discriminability of the inner relationships between features. We propose a pro-contrastive loss to enhance the discriminability at the prototype level by separating hard negative pairs. By incorporating both GCN and the pro-contrastive loss, our model fully explores fine-grained semantic relationships. Experiments on several UDA benchmarks validated that the proposed GVG-PN can clearly outperform the SOTA models.

Approximate & memorize: Settling opposing views in replay-based continuous unsupervised domain adaptation

Continuous Unsupervised Domain Adaptation Using Stabilized Representations and Experience Replay

Unsupervised Domain Adaptation With Class-Aware Memory Alignment

A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithm

Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning

Adaptive online continual multi-view learning

Black-box Unsupervised Domain Adaptation with Bi-directional Atkinson-Shiffrin Memory

EverAdapt: Continuous Adaptation for Dynamic Machine Fault Diagnosis Environments

Memory-Assisted Sub-Prototype Mining for Universal Domain Adaptation

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay

Brain-Inspired Domain-Incremental Adaptive Detection for Autonomous Driving

Continual Recognition with Adaptive Memory Update.

Adversarial Mixup Ratio Confusion for Unsupervised Domain Adaptation.

Deep Unsupervised Convolutional Domain Adaptation

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation

CMFT: Contrastive Memory Feature Transfer for Non-shared-and-Imbalanced Unsupervised Domain Adaption

Continual learning via region-aware memory

Confidence Attention and Generalization Enhanced Distillation for Continuous Video Domain Adaptation

Gradually Vanishing Gap in Prototypical Network for Unsupervised Domain Adaptation

Adaptive Memory Replay for Continual Learning