Prototype-guided domain adaptive one-stage object detector for defect detection

Biaohua Ye,Jianhuang Lai,Xiaohua Xie,Junyong Zhu
DOI: https://doi.org/10.1016/j.aei.2024.102618
IF: 8.8
2024-06-17
Advanced Engineering Informatics
Abstract:Domain adaptive defect detection aims to identify defects in an unlabeled target dataset by leveraging an annotated source dataset that shares similarities. This task poses a significant challenge due to multi-level stylistic differences across production lines and the inherent similarity among different types of defects, compared with domain adaptive object detection. In this paper, we propose a novel Prototype-Guided Domain Adaptive one-stage defect detector (PGDA) to enhance model performance across diverse product lines. Specifically, we propose the global-level feature alignment module (GFA) to mitigate the impact of multi-level stylistic differences between source and target domains. Adversarial training is applied in a multi-scale and multi-level manner by leveraging GFA modules on the features of the backbone, neck, and prediction head. Additionally, we propose the category-level feature alignment module (CFA) to enhance the model's ability to distinguish between various types of defects with similar appearances. By exploring the underlying inter-category and intra-category relationships between source and target domains, we align category-level feature distribution between the two domains. Extensive experiments validate that our method achieves state-of-the-art performances on several domain adaptive defect detection settings. The source code is available at https://github.com/y72428026/PGDA .
engineering, multidisciplinary,computer science, artificial intelligence
What problem does this paper attempt to address?