A real-time and accurate convolutional neural network for fabric defect detection

Xueshen Li,Yong Zhu
DOI: https://doi.org/10.1007/s40747-023-01317-8
IF: 6.7
2024-02-02
Complex & Intelligent Systems
Abstract:Abstract As a practical and challenging task, deep learning-based methods have achieved effective results for fabric defect detection, however, most of them mainly target detection accuracy at the expense of detection speed. Therefore, we propose a fabric defect detection method called PEI-YOLOv5. First, Particle Depthwise Convolution (PDConv) is proposed to extract spatial features more efficiently while reducing redundant computations and memory access, reducing model computation and improving detection speed. Second, Enhance-BiFPN(EB) is proposed based on the structure of BiFPN to enhance the attention of spatial and channel feature maps and the fusion of information at different scales. Third, we improve the loss function and propose IN loss, which improves the problem that the original IOU loss is weak in detecting small targets while speeding up the convergence of the model. Finally, five more common types of defects were selected for training in the GuangDong TianChi fabric defect dataset, and using our proposed PEI-YOLOv5 with only 0.2 Giga Floating Point Operations (GFLOPs) increase, the mAP improved by 3.61%, reaching 87.89%. To demonstrate the versatility of PEI-YOLOv5, we additionally evaluated this in the NEU surface defect database, with the mAP of 79.37%. The performance of PEI-YOLOv 5 in these two datasets surpasses the most advanced fabric defect detection methods at present. We deployed the model to the NVIDIA Jetson TX2 embedded development board, and the detection speed reached 31 frames per second (Fps), which can fully meet the speed requirements of real-time detection.
computer science, artificial intelligence
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the trade-off between speed and accuracy in fabric defect detection. Specifically: 1. **Balancing Detection Speed and Accuracy**: - Most current deep learning-based methods primarily focus on improving detection accuracy, often at the expense of detection speed. Therefore, this paper proposes a new fabric defect detection method, PEI-YOLOv5, aiming to achieve fast and accurate real-time detection. 2. **Efficient Feature Extraction**: - Particle Depthwise Convolution (PDConv) is proposed to extract spatial features more efficiently, reducing redundant computations and memory access, thereby lowering the model's computational load and increasing detection speed. 3. **Multi-Scale Feature Fusion**: - Enhance-BiFPN (EB) is proposed based on the BiFPN structure to enhance the attention of spatial and channel feature maps and to fuse information from different scales. 4. **Improved Loss Function**: - The original IOU loss function is improved, and IN loss is proposed by integrating the normalized Wasserstein distance and CIOU, enhancing the ability to detect small objects and accelerating the model's convergence speed. 5. **Validation in Practical Applications**: - Experiments were conducted on the GuangDong TianChi fabric defect dataset and the NEU surface defect database. The results show that PEI-YOLOv5 outperforms the current state-of-the-art fabric defect detection methods on both datasets. Additionally, when deployed on the NVIDIA Jetson TX2 embedded development board, the detection speed reached 31 frames per second (FPS), meeting the requirements for real-time detection. Through these improvements, the paper aims to develop an efficient and accurate real-time fabric defect detection system to enhance detection efficiency, reduce labor costs, and increase commercial benefits.