Abstract:Semi-supervised domain adaptation (SSDA) has been extensively researched due to its ability to improve classification performance and generalization ability of models by using a small amount of labeled data on the target domain. However, existing methods cannot effectively adapt to the target domain due to difficulty in fully learning rich and complex target semantic information and relationships. In this paper, we propose a novel SSDA learning framework called semantic regularization learning (SERL), which captures the target semantic information from multiple perspectives of regularization learning to achieve adaptive fine-tuning of the source pre-trained model on the target domain. SERL includes three robust semantic regularization techniques. Firstly, semantic probability contrastive regularization (SPCR) helps the model learn more discriminative feature representations from a probabilistic perspective, using semantic information on the target domain to understand the similarities and differences between samples. Additionally, adaptive weights in SPCR can help the model learn the semantic distribution correctly through the probabilities of different samples. To further comprehensively understand the target semantic distribution, we introduce hard-sample mixup regularization (HMR), which uses easy samples as guidance to mine the latent target knowledge contained in hard samples, thereby learning more complete and complex target semantic knowledge. Finally, target prediction regularization (TPR) regularizes the target predictions of the model by maximizing the correlation between the current prediction and the past learned objective, thereby mitigating the misleading of semantic information caused by erroneous pseudo-labels. Extensive experiments on three benchmark datasets demonstrate that our SERL method achieves state-of-the-art performance.

Semi-supervised Domain Adaptation via Joint Transductive and Inductive Subspace Learning

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

ECACL - A Holistic Framework for Semi-Supervised Domain Adaptation.

Semi-supervised Domain Adaptation Via Subspace Exploration

Semi-supervised Domain Adaptation with Subspace Learning for Visual Recognition

Joint Distribution Alignment and Transfer Subspace Learning for Unsupervised Domain Adaptation

Semi-Supervised Domain Adaptation by Similarity based Pseudo-label Injection

Semi-Supervised Domain Adaptation Via Asymmetric Joint Distribution Matching

Unsupervised Transductive Domain Adaptation

Unsupervised Domain Adaptation With Joint Supervised Sparse Coding And Discriminative Regularization Term

Semi-Supervised Domain Adaptation via Adaptive and Progressive Feature Alignment

Source-free Semantic Regularization Learning for Semi-supervised Domain Adaptation

Semi-supervised Domain Adaptation for Semantic Segmentation

A Two-stage Cascading Method Based on Finetuning in Semi-supervised Domain Adaptation Semantic Segmentation

Open Set Domain Adaptation Via Joint Alignment and Category Separation.

Transferable Semantic Augmentation for Domain Adaptation

Inter-Domain Mixup for Semi-Supervised Domain Adaptation

Learning Invariant Representation with Consistency and Diversity for Semi-supervised Source Hypothesis Transfer.

Semi-Supervised Domain Adaptation with Prototypical Alignment and Consistency Learning

A Multi-View Consistency Framework with Semi-Supervised Domain Adaptation

Align and Adapt: A Two-stage Adaptation Framework for Unsupervised Domain Adaptation