Rectifying Self-Training with Neighborhood Consistency and Proximity for Source-Free Domain Adaptation

Bowei Xing,Xianghua Ying,Ruibin Wang
DOI: https://doi.org/10.1016/j.neucom.2024.128425
IF: 6
2024-01-01
Neurocomputing
Abstract:Source-free domain adaptation (SFDA) seeks to transfer knowledge from the source domain to the target domain by leveraging only unlabeled target data and pre-trained source model, without accessing source data. Existing approaches for SFDA heavily depend on self-training, involving the generation of pseudo-labels on the target domain. However, these generated labels inevitably suffer from incorrect predictions due to distribution discrepancy, making the training process vulnerable to pseudo-label noise. To track this issue, in this paper, we propose neighborhood semantic consistency and neighborhood spatial proximity to distinguish sample importance and incorporate them to rectify self-training. Specifically, we refer to the sample relationship with nearby neighbors to evaluate the pseudo-label reliability of target samples, explicitly serving as regularization for the optimizing objective. The neighborhood consistency is calculated based on the similarity of sample-wise and data-structure predictions, describing local semantic uniformity, while the neighborhood proximity is calculated by considering the feature distances to nearby samples, which measures local spatial affinity. Furthermore, a regularized neighborhood alignment term is introduced, which adaptively integrates self-distillation with neighborhood supervision to boost representation learning. Comprehensive experiments across several different SFDA benchmarks demonstrate the efficacy of our approach. Further analyses substantiate that the proposed approach exhibits superior robustness against pseudo-label noise, which leads to notable enhancements when compared with conventional pseudo-label-based self-training. The codes of our method are available at https://github.com/xingbw/Rectified-Self-Training.
What problem does this paper attempt to address?