Clustering Environment Aware Learning for Active Domain Adaptation
Jian Zhu,Xinyu Chen,Qintai Hu,Yutang Xiao,Boyu Wang,Bin Sheng,C. L. Philip Chen
DOI: https://doi.org/10.1109/tsmc.2024.3374068
2024-01-01
IEEE Transactions on Systems, Man, and Cybernetics: Systems
Abstract:Despite the significant progress in unsupervised domain adaptation (UDA), the performance of UDA methods is still far inferior to that of the fully supervised ones. In practical scenarios, it is usually feasible to acquire labels on a small portion of the target data through active learning (AL), which aims to train an effective model with as few queried instances as possible. However, due to the domain shift, the instances selected by existing AL algorithms can be uninformative, redundant, or outlying. To address this issue, we propose a novel approach, namely, clustering environment-aware learning (CEAL), for active domain adaptation (ADA). CEAL selects potentially the most valuable instances under domain shift by exploring the informativeness and representativeness of target samples in a clustering environment-aware manner. Specifically, for the informativeness, we not only leverage the knowledge of individual points but also their nearby neighbors, by measuring the proposed clustering environment aware informativeness score (CEAIS), thus ensuring that the selected samples are highly informative. For the representativeness, we design two schemes called point distance release (PDR) and informativeness score difference exclusion (ISDE) to guarantee the diversity and validity of the selected samples. Furthermore, we fully utilize the large amount of unlabeled data from target domain via pseudo labeling and adopt information maximization to improve the reliability of the target pseudo labels, thereby further improving the performance of the model. The effectiveness of our method is empirically verified on various benchmark datasets against recent state-of-the-art algorithms.
automation & control systems,computer science, cybernetics