Self-supervised assisted multi-task learning network for one-shot defect segmentation with fake defect generation

Ziqiang Hu,Hao Chu,Yunzhou Zhang,Dexing Shan,You Shen
DOI: https://doi.org/10.1016/j.patrec.2024.05.017
IF: 4.757
2024-06-02
Pattern Recognition Letters
Abstract:Object surface defect segmentation is extremely crucial for automatic quality inspection in the field of industrial production. However, following deficiencies of most current defect semantic algorithms such as over-reliance on large-scale labeled datasets, underutilization of unlabeled defect-free (normal) samples, and restrictions on the type of material have limited the application of these algorithms. To solve these problems, we propose a novel self-supervised assisted multi-task learning network (SAMLNet) to segment the defects of several different types of materials. Making full use of unlabeled defect-free samples, we introduce an efficient self-supervised segmentation (SSS) task not only to assist in training parameters of the backbone shared with the one-shot segmentation (OSS) task but also to predict the rough mask of the actual defect image through the semantic representation (background prototype). To extract the representation, we propose a two-stage training method to accelerate model convergence. Since small or slender defects are common, we propose a high-pixel feature attention module to reserve more details of the defect area. Extensive experiments show that the proposed method outperforms the state-of-the-art methods across several defect datasets, demonstrating the effectiveness of our method.
computer science, artificial intelligence
What problem does this paper attempt to address?