Abstract:Deep neural networks usually depend on substantial labeled data and suffer from poor generalization to new domains. Domain adaptation can be used to resolve these issues, using a classifier trained with a label-rich source and transferred to a label-scarce target domain. Traditional domain adaptation adopts the close-set assumption that both domains share the same classes. However, real-world applications operate in an open-set scenario where target domains have private categories. This aspect is considered by open-set domain adaptation (OSDA). Nevertheless, current OSDA benchmarks lack clear definitions of semantic classes that are at the core of the open-set concept. In this study, we propose fine-grained visual categorization (FGVC) datasets containing specific descriptions of semantic classes as a solution, introducing the new setting named fine-grained OSDA. Owing to the entanglement among FGVC, unknown class recognition, and domain adaptation, fine-grained OSDA is a challenging task. For this reason, we designed a weighted discriminative adversarial network with dual classifiers (WDAN). It utilizes a selective transformer encoder with overlapping patches and supervised contrastive learning to extract features suitable for FGVC, adversarial training with domain-specific discriminative information to recognize target-private classes, and a weighted conditional domain discriminator to learn domain-invariant features for domain adaptation. Extensive experiments on five benchmarks, including one newly built, demonstrated that WDAN outperforms state-of-the-art methods. This work fills the existing gap in benchmarks for fine-grained OSDA, promoting future developments of real-world applications.

Coarse Helps Fine: A Multi-Granularity Discriminative Adversarial Network for Fine-Grained Open-Set Domain Adaptation.

Fine-Grained Visual Categorization With Fine-Tuned Segmentation

WDAN: A Weighted Discriminative Adversarial Network with Dual Classifiers for Fine-Grained Open-Set Domain Adaptation

Adaptive Open Domain Recognition by Coarse-to-fine Prototype-Based Network

Bilinear Adversarial Network for Fine-Grained Domain Adaptation.

An Adversarial Domain Adaptation Network for Cross-Domain Fine-Grained Recognition

Progressive Adversarial Networks for Fine-Grained Domain Adaptation.

Enhancing open-set domain adaptation through unknown-filtering multi-classifier adversarial network

GCL-OSDA: Uncertainty prediction-based graph collaborative learning for open-set domain adaptation

Fine-grained Category Discovery under Coarse-grained Supervision with Hierarchical Weighted Self-contrastive Learning

Beyond the Known: Enhancing Open Set Domain Adaptation with Unknown Exploration

Adversarial Fine-Grained Adaptation Network for Cross-Scene Classification.

Open Set Domain Adaptation By Novel Class Discovery

Open Set Domain Adaptation With Soft Unknown-Class Rejection

Granularity-aware Distillation and Structure Modeling Region Proposal Network for Fine-Grained Image Classification.

Multi-source Open-Set Image Classification Based on Deep Adversarial Domain Adaptation

Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentation

CAMV: Class Activation Mapping Value Towards Open Set Fine-Grained Recognition

Open Set Domain Adaptation Via Joint Alignment and Category Separation.

Multiple Granularity Descriptors for Fine-Grained Categorization.

Open-set domain adaptation by deconfounding domain gaps