LEAD: Learning Decomposition for Source-free Universal Domain Adaptation

Sanqing Qu,Tianpei Zou,Lianghua He,Florian Röhrbein,Alois Knoll,Guang Chen,Changjun Jiang
2024-03-06
Abstract:Universal Domain Adaptation (UniDA) targets knowledge transfer in the presence of both covariate and label shifts. Recently, Source-free Universal Domain Adaptation (SF-UniDA) has emerged to achieve UniDA without access to source data, which tends to be more practical due to data protection policies. The main challenge lies in determining whether covariate-shifted samples belong to target-private unknown categories. Existing methods tackle this either through hand-crafted thresholding or by developing time-consuming iterative clustering strategies. In this paper, we propose a new idea of LEArning Decomposition (LEAD), which decouples features into source-known and -unknown components to identify target-private data. Technically, LEAD initially leverages the orthogonal decomposition analysis for feature decomposition. Then, LEAD builds instance-level decision boundaries to adaptively identify target-private data. Extensive experiments across various UniDA scenarios have demonstrated the effectiveness and superiority of LEAD. Notably, in the OPDA scenario on VisDA dataset, LEAD outperforms GLC by 3.5% overall H-score and reduces 75% time to derive pseudo-labeling decision boundaries. Besides, LEAD is also appealing in that it is complementary to most existing methods. The code is available at
Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The paper aims to address the problem of Source-free Universal Domain Adaptation (SF-UniDA). Specifically, the core issue of the research is: **How to identify unknown category data in the target domain without accessing source data?** Existing methods typically solve this problem by manually setting thresholds or adopting time-consuming iterative clustering strategies, but these methods have certain limitations. For example, manually setting thresholds is difficult to apply to all scenarios and often yields suboptimal results; while iterative clustering strategies are effective, they tend to overfit in high-dimensional spaces and have high computational costs. To address these issues, the authors propose a new method called Learning Decomposition (LEAD). LEAD effectively identifies unknown category data in the target domain by decomposing features into known source domain parts and unknown source domain parts. This method not only avoids complex parameter adjustments but also overcomes the instability and computational complexity issues of traditional clustering methods in high-dimensional data. Experimental results show that LEAD performs excellently in various SF-UniDA scenarios and can serve as an effective complement to existing SF-UniDA methods.