Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Latent Diffusion Models to Enhance the Performance of Visual Defect Segmentation Networks in Steel Surface Inspection

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Latent Space Segmentation Model for Visual Surface Defect Inspection

Unveiling the potential of progressive training diffusion model for defect image generation and recognition in industrial processes

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

Leveraging Latent Diffusion Models for Training-Free In-Distribution Data Augmentation for Surface Defect Detection

Defect Image Sample Generation With Diffusion Prior for Steel Surface Defect Recognition

Yolo-sd: simulated feature fusion for few-shot industrial defect detection based on YOLOv8 and stable diffusion

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

A deep learning model for steel surface defect detection

TLU-Net: A Deep Learning Approach for Automatic Steel Surface Defect Detection

Dual attention deep learning network for automatic steel surface defect segmentation

Synthetic data generation using finite element method to pre-train an image segmentation model for defect detection using infrared thermography

A lightweight image-level segmentation method for steel surface defects based on cross-layer feature fusion

Controllable Image Synthesis of Industrial Data Using Stable Diffusion

STFE-Net: A multi-stage approach to enhance statistical texture feature for defect detection on metal surfaces

Region- and Strength-Controllable GAN for Defect Generation and Segmentation in Industrial Images

A Novel Approach to Industrial Defect Generation through Blended Latent Diffusion Model with Online Adaptation

Depth feature fusion based surface defect region identification method for steel plate manufacturing

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs