Multi-surface defect detection for universal joint bearings via multimodal feature and deep transfer learning

Zetian Zhao,Bingtao Hu,Yixiong Feng,Bin Zhao,Chen Yang,Zhaoxi Hong,Jianrong Tan
DOI: https://doi.org/10.1080/00207543.2022.2138613
IF: 9.018
2022-11-09
International Journal of Production Research
Abstract:Surface defect detection by machine vision has received increased attention concerning the quality control of universal joint bearings (UJB). The defect distribution and counting information are important for product quality optimisation. However, vision defect detection for UJB remains a challenging task due to the diversity of background textures and defect characters on multiple surfaces. In this study, a multi-surface defect detection (MSDD) method consisting of region segmentation, feature extraction and detection is proposed. First, defect regions are accurately localised by the proposed adaptive defect region segmentation algorithm, which suppresses the inference of background variety. Then, a novel defect feature named multimodal fusion shape descriptor that integrates the global information and local information of defects is constructed to generate the discriminative defect representation. Finally, a defect feature extraction ability transfer strategy based on the transfer learning mechanism is proposed to address the problem of insufficient defect samples. The experimental results show that our method achieves the best accuracy of 94.8% macro-F1 and processes 28 defect images per second. Besides, the application effect in the practical production line indicates that our method meets the accuracy and real-time requirements of MSDD for UJB.
engineering, manufacturing, industrial,operations research & management science
What problem does this paper attempt to address?