Abstract:In the unsupervised open set domain adaptation (UOSDA), the target domain contains unknown classes that are not observed in the source domain. Researchers in this area aim to train a classifier to accurately: 1) recognize unknown target data (data with unknown classes) and 2) classify other target data. To achieve this aim, a previous study has proven an upper bound of the target-domain risk, and the open set difference, as an important term in the upper bound, is used to measure the risk on unknown target data. By minimizing the upper bound, a shallow classifier can be trained to achieve the aim. However, if the classifier is very flexible [e.g., deep neural networks (DNNs)], the open set difference will converge to a negative value when minimizing the upper bound, which causes an issue where most target data are recognized as unknown data. To address this issue, we propose a new upper bound of target-domain risk for UOSDA, which includes four terms: source-domain risk, ϵ -open set difference ( ∆ϵ ), distributional discrepancy between domains, and a constant. Compared with the open set difference, ∆ϵ is more robust against the issue when it is being minimized, and thus we are able to use very flexible classifiers (i.e., DNNs). Then, we propose a new principle-guided deep UOSDA method that trains DNNs via minimizing the new upper bound. Specifically, source-domain risk and ∆ϵ are minimized by gradient descent, and the distributional discrepancy is minimized via a novel open set conditional adversarial training strategy. Finally, compared with the existing shallow and deep UOSDA methods, our method shows the state-of-the-art performance on several benchmark datasets, including digit recognition [modified National Institute of Standards and Technology database (MNIST), the Street View House Number (SVHN), U.S. Postal Service (USPS)], object recognition (Office-31, Office-Home), and face recognition [pose, illumination, and expression (PIE)].

GCL-OSDA: Uncertainty prediction-based graph collaborative learning for open-set domain adaptation

Open-set domain adaptation by deconfounding domain gaps

Open Set Domain Adaptation By Novel Class Discovery

Open Set Domain Adaptation With Soft Unknown-Class Rejection

Cluster-based Adversarial Decision Boundary for domain-adaptive open set recognition

Beyond the Known: Enhancing Open Set Domain Adaptation with Unknown Exploration

Uncertainty-Aware Aggregation for Federated Open Set Domain Adaptation

Bridging the Theoretical Bound and Deep Algorithms for Open Set Domain Adaptation

Open Set Domain Adaptation: Theoretical Bound and Algorithm

Coarse Helps Fine: A Multi-Granularity Discriminative Adversarial Network for Fine-Grained Open-Set Domain Adaptation.

Open Set Domain Recognition Via Attention-Based GCN and Semantic Matching Optimization

Discovering Implicit Classes Achieves Open Set Domain Adaptation

Uncertainty-guided Open-Set Source-Free Unsupervised Domain Adaptation with Target-private Class Segregation

Enhancing open-set domain adaptation through unknown-filtering multi-classifier adversarial network

Progressively Select and Reject Pseudo-labelled Samples for Open-Set Domain Adaptation

Open set domain adaptive method based on energy separation strategy

Imbalanced Open Set Domain Adaptation via Moving-threshold Estimation and Gradual Alignment

Balanced Open Set Domain Adaptation Via Centroid Alignment.

Adversarial open set domain adaptation via progressive selection of transferable target samples

Mind the Gap: Enlarging the Domain Gap in Open Set Domain Adaptation

Unknown Sample Discovery for Source Free Open Set Domain Adaptation