Proposal-level reliable feature-guided contrastive learning for SFOD
Xing Wei,Jiong Xia,Cang Liu,Qi-wen He,Jun Chen,Zhen Wei,Chong Zhao,Fan Yang,Yang Lu
DOI: https://doi.org/10.1007/s11227-024-06773-8
IF: 3.3
2024-12-09
The Journal of Supercomputing
Abstract:Domain adaptive object detection (DAOD) is an effective approach to solving the domain shift problem, which aims to improve the generalization ability on the target domain through joint training with labeled source domain and unlabeled target domain data. However, in the real world, the source domain is often inaccessible due to privacy, legal, and regulatory reasons. Source-free object detection (SFOD) adapts a well-trained source domain object detector to the target domain without needing access to source domain data. Most existing SFOD methods are based on a self-training framework (such as the teacher–student framework), where the teacher model guides the student model's training by setting a confidence threshold to filter out unreliable pseudo-labels. However, this may lead to the loss of semantic information in the target domain, resulting in suboptimal model performance. Therefore, in this paper, we propose a contrastive learning framework guided by proposal-level reliable feature guidance. Specifically, we first build a general self-training framework based on Faster-RCNN. Then, we introduce a novel proposal-level pseudo-label annotation and filtering method (PAF), improving the annotation and filtering of pseudo-labels and obtaining proposal-level reliable features. Next, we design reliable feature banks to categorize and store reliable proposal features. Finally, we propose classification contrastive learning (CCL) and bounding box contrastive learning (BCL) to further extract semantic information from reliable proposal features, learning the lost semantic information in the target domain. Extensive experiments on seven benchmark datasets demonstrate the effectiveness of our method.
computer science, theory & methods,engineering, electrical & electronic, hardware & architecture