Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Digital Defect Simulation-based Data Generation for Visual Quality Inspection.

A Novel Defect Detection System for Complex Freeform Surface Structures

Physically-based Data Augmentation for Deep Learning-Enabled Automated Visual Inspection of Scratches

Synthetic training data generation for deep learning based quality inspection

Few-shot defect detection using feature enhancement and image generation for manufacturing quality inspection

A Surface Defect Detection Method Based on Image Guided Conditional Diffusion Model

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Surface defect detection of industrial components based on vision

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

An Overview of Image Generation of Industrial Surface Defects

A Four-Stage Product Appearance Defect Detection Method With Small Samples

A Physics-Based Defects Model and Inspection Algorithm for Automatic Visual Inspection

Image Data Assessment Approach for Deep Learning-Based Metal Surface Defect-Detection Systems

Deep CNN-based visual defect detection: Survey of current literature

Recent advances in surface defect inspection of industrial products using deep learning techniques

Machine Vision Product Appearance Defect Detection Based on Deep Learning

Yolo-sd: simulated feature fusion for few-shot industrial defect detection based on YOLOv8 and stable diffusion

Detecting and Classifying Defective Products in Images Using YOLO

Automated Defect Report Generation for Enhanced Industrial Quality Control

Synthetic Defect Generation for Display Front-of-Screen Quality Inspection: A Survey