Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Internal Thread Defect Generation Algorithm and Detection System Based on Generative Adversarial Networks and You Only Look Once

Internal thread defect detection system based on multi-vision

Research on Modified Algorithms of Cylindrical External Thread Profile Based on Machine Vision

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

An effective defect detection method based on improved Generative Adversarial Networks (iGAN) for machined surfaces

DG-GAN: A High Quality Defect Image Generation Method for Defect Detection

Surface Defect Detection of Mobile Phone Screen Based on Generative Adversarial Networks

A Survey of Defect Detection Applications Based on Generative Adversarial Networks

A High-Quality Sample Generation Method for Improving Steel Surface Defect Inspection

Image synthesis of apparel stitching defects using deep convolutional generative adversarial networks

An Improved GANs Model for Steel Plate Defect Detection

Online Fabric Defects Detection Using Convolutional Neural Networks with Two Frameworks

P‐4.10: Simulation Algorithm of Industrial Defects based on Generative Adversarial Network

Few-shot defect detection using feature enhancement and image generation for manufacturing quality inspection

Multistage GAN for Fabric Defect Detection

A Generative Adversarial Network Based Deep Learning Method for Low-Quality Defect Image Reconstruction and Recognition

Performance Enhancement of Ultrasonic Weld Defect Detection Network Based on Generative Data

Few-Shot Defect Image Generation via Defect-Aware Feature Manipulation

Tool Condition Monitoring Method Based on Generative Adversarial Network for Data Augmentation

Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application

DP-GAN: A Transmission Line Bolt Defects Generation Network Based on Dual Discriminator Architecture and Pseudo-Enhancement Strategy