CNN-based Labelled Crack Detection for Image Annotation

Mohsen Asghari Ilani,Leila Amini,Hossein Karimi,Maryam Shavali Kuhshuri

2024-08-21

Abstract:Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 x 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **In the surface of additive manufacturing (AM), how to detect crack defects efficiently and accurately**.

Specifically, traditional image processing techniques (IPTs) face challenges in the face of diverse real - world scenarios and different types of cracks. These techniques usually require a complex feature extraction process and perform poorly when dealing with complex cracks generated during the additive manufacturing process. To overcome these problems, this research proposes a visual method based on deep convolutional neural network (CNN) for detecting crack defects on AM surfaces.

### Main problems and solutions:
1. **Limitations of traditional image processing techniques**:
- Traditional methods are difficult to deal with diverse real - world scenarios and different types of cracks.
- A large amount of feature extraction work is required, increasing the processing difficulty and time cost.

2. **CNN - based solutions**:
- Use the deep convolutional neural network (CNN) to automatically learn crack features without manual feature extraction.
- Use the LabelImg tool for image annotation, simplifying the data preparation process.
- Combine OpenCV pre - processing techniques to improve the accuracy and robustness of the model.

### Experimental results:
- On a dataset containing 14,982 labeled images, the trained CNN model achieved an accuracy of 99.54%.
- Evaluation metrics include: precision exceeding 96%, recall reaching 98%, and F1 - score of 97%, indicating that this method has high precision and effectiveness in crack detection.

### Summary:
This research significantly improves the efficiency and accuracy of crack detection on additive manufacturing surfaces by introducing an intelligent CNN - based method, reduces the dependence on manual annotation and feature extraction, and provides strong support for industrial applications.