High-order Neighborhoods Know More: HyperGraph Learning Meets Source-free Unsupervised Domain Adaptation

Jinkun Jiang,Qingxuan Lv,Yuezun Li,Yong Du,Sheng Chen,Hui Yu,Junyu Dong
DOI: https://doi.org/10.48550/arxiv.2405.06916
2024-01-01
Abstract:Source-free Unsupervised Domain Adaptation (SFDA) aims to classify targetsamples by only accessing a pre-trained source model and unlabelled targetsamples. Since no source data is available, transferring the knowledge from thesource domain to the target domain is challenging. Existing methods normallyexploit the pair-wise relation among target samples and attempt to discovertheir correlations by clustering these samples based on semantic features. Thedrawback of these methods includes: 1) the pair-wise relation is limited toexposing the underlying correlations of two more samples, hindering theexploration of the structural information embedded in the target domain; 2) theclustering process only relies on the semantic feature, while overlooking thecritical effect of domain shift, i.e., the distribution differences between thesource and target domains. To address these issues, we propose a new SFDAmethod that exploits the high-order neighborhood relation and explicitly takesthe domain shift effect into account. Specifically, we formulate the SFDA as aHypergraph learning problem and construct hyperedges to explore the local groupand context information among multiple samples. Moreover, we integrate aself-loop strategy into the constructed hypergraph to elegantly introduce thedomain uncertainty of each sample. By clustering these samples based onhyperedges, both the semantic feature and domain shift effects are considered.We then describe an adaptive relation-based objective to tune the model withsoft attention levels for all samples. Extensive experiments are conducted onOffice-31, Office-Home, VisDA, and PointDA-10 datasets. The results demonstratethe superiority of our method over state-of-the-art counterparts.
What problem does this paper attempt to address?