Abstract:In this paper, we study the formalism of unsupervised multi-class domain adaptation (multi-class UDA), which underlies a few recent algorithms whose learning objectives are only motivated empirically. Multi-Class Scoring Disagreement (MCSD) divergence is presented by aggregating the absolute margin violations in multi-class classification, and this proposed MCSD is able to fully characterize the relations between any pair of multi-class scoring hypotheses. By using MCSD as a measure of domain distance, we develop a new domain adaptation bound for multi-class UDA; its data-dependent, probably approximately correct bound is also developed that naturally suggests adversarial learning objectives to align conditional feature distributions across source and target domains. Consequently, an algorithmic framework of Multi-class Domain-adversarial learning Networks (McDalNets) is developed, and its different instantiations via surrogate learning objectives either coincide with or resemble a few recently popular methods, thus (partially) underscoring their practical effectiveness. Based on our identical theory for multi-class UDA, we also introduce a new algorithm of Domain-Symmetric Networks (SymmNets), which is featured by a novel adversarial strategy of domain confusion and discrimination. SymmNets affords simple extensions that work equally well under the problem settings of either closed set, partial, or open set UDA. We conduct careful empirical studies to compare different algorithms of McDalNets and our newly introduced SymmNets. Experiments verify our theoretical analysis and show the efficacy of our proposed SymmNets. In addition, we have made our implementation code publicly available.

Domain Consistency Regularization for Unsupervised Multi-source Domain Adaptive Classification

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

Aligning Domain-Specific Distribution and Classifier for Cross-Domain Classification from Multiple Sources

Domain-specific Feature Recalibration and Alignment for Multi-Source Unsupervised Domain Adaptation

Domain Adaptation Based Multi-Source Data Fusion for Pattern Classification

Consistency regularization-based mutual alignment for source-free domain adaptation

A New Progressive Multisource Domain Adaptation Network with Weighted Decision Fusion.

Deep Joint Semantic Adaptation Network for Multi-source Unsupervised Domain Adaptation

Dynamic Domain Discrepancy Adjustment for Active Multi-Domain Adaptation

Exploiting multi-level consistency learning for source-free domain adaptation

Multi-Source domain adaptation via supervised contrastive learning and confident consistency regularization

Multi-Source Unsupervised Domain Adaptation Via Pseudo Target Domain

Reliable Domain Adaptation With Classifiers Competition

A Multi-Grained Unsupervised Domain Adaptation Approach for Semantic Segmentation

Reliable Domain Adaptation With Classifiers Competition For Image Classification

Unsupervised Multi-Class Domain Adaptation: Theory, Algorithms, and Practice

A Two-Way Alignment Approach for Unsupervised Multi-Source Domain Adaptation

Adaptive Prototype and Consistency Alignment for Semi-Supervised Domain Adaptation

Cycle Consistency Based Pseudo Label and Fine Alignment for Unsupervised Domain Adaptation

Enhanced Unsupervised Domain Adaptation with Dual-Attention Between Classification and Domain Alignment.

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning