Uncertainty-Aware Pseudo-Label Filtering for Source-Free Unsupervised Domain Adaptation

Xi Chen,Haosen Yang,Huicong Zhang,Hongxun Yao,Xiatian Zhu

DOI: https://doi.org/10.1016/j.neucom.2023.127190

2024-03-18

Abstract:Source-free unsupervised domain adaptation (SFUDA) aims to enable the utilization of a pre-trained source model in an unlabeled target domain without access to source data. Self-training is a way to solve SFUDA, where confident target samples are iteratively selected as pseudo-labeled samples to guide target model learning. However, prior heuristic noisy pseudo-label filtering methods all involve introducing extra models, which are sensitive to model assumptions and may introduce additional errors or mislabeling. In this work, we propose a method called Uncertainty-aware Pseudo-label-filtering Adaptation (UPA) to efficiently address this issue in a coarse-to-fine manner. Specially, we first introduce a sample selection module named Adaptive Pseudo-label Selection (APS), which is responsible for filtering noisy pseudo labels. The APS utilizes a simple sample uncertainty estimation method by aggregating knowledge from neighboring samples and confident samples are selected as clean pseudo-labeled. Additionally, we incorporate Class-Aware Contrastive Learning (CACL) to mitigate the memorization of pseudo-label noise by learning robust pair-wise representation supervised by pseudo labels. Through extensive experiments conducted on three widely used benchmarks, we demonstrate that our proposed method achieves competitive performance on par with state-of-the-art SFUDA methods. Code is available at

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper primarily proposes a novel solution to the problem of Source-free Unsupervised Domain Adaptation (SFUDA). The goal of SFUDA is to adapt a pre-trained source model to unlabelled target domain data without accessing the source data. Specifically, the paper addresses the issue of noisy pseudo-labels generated during self-training.

The main contributions of the paper can be summarized as follows:

1. **Proposed an Uncertainty-aware Pseudo-label Filtering Framework (UPA)**: This framework effectively handles the high noise problem of pseudo-labels in SFUDA tasks without introducing additional models for uncertainty estimation. The key component is the Adaptive Pseudo-label Selection (APS) mechanism, which efficiently filters out noisy pseudo-labels by considering information from neighboring samples.

2. **Introduced a Class-Aware Contrastive Learning (CACL) strategy**: This strategy further reduces the impact of pseudo-label noise through class-level contrastive learning, ensuring more robust learning of clean pseudo-label samples. This method helps prevent the model from memorizing noisy labels and ensures intra-class semantic consistency in the target data.

3. **Conducted extensive experimental validation**: The authors performed numerous experiments on three standard datasets (Office, Office-Home, and VisDA-C), demonstrating the advantages of the proposed method over existing techniques.

In short, by introducing the APS and CACL core components, the paper not only addresses the pseudo-label noise issue but also improves the model's performance in the target domain. These methods do not require additional model assumptions, making the entire framework both simple and effective.