Abstract:In the unsupervised open set domain adaptation (UOSDA), the target domain contains unknown classes that are not observed in the source domain. Researchers in this area aim to train a classifier to accurately: 1) recognize unknown target data (data with unknown classes) and 2) classify other target data. To achieve this aim, a previous study has proven an upper bound of the target-domain risk, and the open set difference, as an important term in the upper bound, is used to measure the risk on unknown target data. By minimizing the upper bound, a shallow classifier can be trained to achieve the aim. However, if the classifier is very flexible [e.g., deep neural networks (DNNs)], the open set difference will converge to a negative value when minimizing the upper bound, which causes an issue where most target data are recognized as unknown data. To address this issue, we propose a new upper bound of target-domain risk for UOSDA, which includes four terms: source-domain risk, ϵ -open set difference ( ∆ϵ ), distributional discrepancy between domains, and a constant. Compared with the open set difference, ∆ϵ is more robust against the issue when it is being minimized, and thus we are able to use very flexible classifiers (i.e., DNNs). Then, we propose a new principle-guided deep UOSDA method that trains DNNs via minimizing the new upper bound. Specifically, source-domain risk and ∆ϵ are minimized by gradient descent, and the distributional discrepancy is minimized via a novel open set conditional adversarial training strategy. Finally, compared with the existing shallow and deep UOSDA methods, our method shows the state-of-the-art performance on several benchmark datasets, including digit recognition [modified National Institute of Standards and Technology database (MNIST), the Street View House Number (SVHN), U.S. Postal Service (USPS)], object recognition (Office-31, Office-Home), and face recognition [pose, illumination, and expression (PIE)].

Delving into Local Features for Open-Set Domain Adaptation in Fundus Image Analysis

Denoising for Relaxing: Unsupervised Domain Adaptive Fundus Image Segmentation Without Source Data

Partial Unbalanced Feature Transport for Cross-Modality Cardiac Image Segmentation

Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis

Imbalanced Open Set Domain Adaptation via Moving-threshold Estimation and Gradual Alignment

A Structure-aware Framework of Unsupervised Cross-Modality Domain Adaptation via Frequency and Spatial Knowledge Distillation

Federated Ophthalmic Disease Diagnosis Based on Weighted Averaging and Local Optimization

Multi-Source Domain Adaptation for Medical Image Segmentation.

IOSUDA: an unsupervised domain adaptation with input and output space alignment for joint optic disc and cup segmentation

Source free domain adaptation for medical image segmentation with fourier style mining

Source-free Active Domain Adaptation for Diabetic Retinopathy Grading Based on Ultra-wide-field Fundus Image

Superpixel-guided class-level denoising for unsupervised domain adaptive fundus image segmentation without source data

Open Set Domain Adaptation: Theoretical Bound and Algorithm

Reducing Domain Gap in Frequency and Spatial domain for Cross-modality Domain Adaptation on Medical Image Segmentation

Unsupervised domain adaptation model for lesion detection in retinal OCT images

Source-free active domain adaptation for diabetic retinopathy grading based on ultra-wide-field fundus images

Reconstruction-driven Dynamic Refinement based Unsupervised Domain Adaptation for Joint Optic Disc and Cup Segmentation

A novel 3D unsupervised domain adaptation framework for cross-modality medical image segmentation

Bridging the Theoretical Bound and Deep Algorithms for Open Set Domain Adaptation

Diffuse-UDA: Addressing Unsupervised Domain Adaptation in Medical Image Segmentation with Appearance and Structure Aligned Diffusion Models

Data privacy protection domain adaptation by roughing and finishing stage