Cross-supervised contrastive learning domain adaptation network for steel defect segmentation

Lixiang Zhao,Yulong Zhang,Jie Duan,Jianbo Yu
DOI: https://doi.org/10.1016/j.aei.2024.102964
IF: 8.8
2024-12-06
Advanced Engineering Informatics
Abstract:Defect segmentation is a vital approach to ensure the quality of steel. Convolutional neural network (CNN) has significantly enhanced steel defect segmentation performance. However, in practical scenario, steel defects exhibit great difference in appearance and background due to complex working conditions. It is challenging to perform steel defect segmentation under polytopic conditions. In this article, a cross-supervised contrastive learning domain adaptation network (CSCLDAN) is proposed for steel defect segmentation. Firstly, to alleviate domain shift posed by variations in defect appearance, a cross-supervised learning network that leverages CNN and Transformer is proposed to extract comprehensive features by facilitating the interaction of local and global information from different domains simultaneously. Secondly, for the domain shift caused by contextual difference, self-aware consistency contrastive learning is proposed to maintain consistency of the same defect features under different contexts. Finally, bidirectional pixel feature alignment loss is proposed to achieve self-aware consistency, which enables features from positive samples closer and separates features from negative samples. The effectiveness of CSCLDAN is verified on four typical steel defect datasets and the testing results demonstrate that CSCLDAN outperforms other state-of-the-art domain adaptation models.
engineering, multidisciplinary,computer science, artificial intelligence
What problem does this paper attempt to address?