Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

A fast-training GAN for coal–gangue image augmentation based on a few samples

A Data Expansion Strategy for Improving Coal-Gangue Detection

Enhancing Coal-Gangue Object Detection Using GAN-based Data Augmentation Strategy with Dual Attention Mechanism

High Quality Coal Foreign Object Image Generation Method Based on StyleGAN-DSAD

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis

A fast recognition method for coal gangue image processing

STATNet: One-stage Coal-Gangue Detector Based on Deep Learning Algorithm for Real Industrial Application

Image Recognition of Coal and Coal Gangue Using a Convolutional Neural Network and Transfer Learning

Improved Generative Adversarial Network for Super-Resolution Reconstruction of Coal Photomicrographs

Data-driven Model SSD-BSP for Multi-Target Coal-Gangue Detection

Data augmentation in material images using the improved HP-VAE-GAN

Optimization Study of Coal Gangue Detection in Intelligent Coal Selection Systems Based on the Improved Yolov8n Model

Detecting Coal Content in Gangue Via Machine Vision and Genetic Algorithm-Backpropagation Neural Network

Faster Projected GAN: Towards Faster Few-Shot Image Generation

A high accuracy detection method for coal and gangue with S3DD-YOLOv8

A fast gangue detection algorithm based on multi-head self-attention mechanism and anchor frame optimization strategy

Direct Adversarial Training for GANs

Sketch-guided spatial adaptive normalization and high-level feature constraints based GAN image synthesis for steel strip defect detection data augmentation

GEGAN: Generative Adversarial Networks Training Based on Gradient Directed Evolutionary Strategy

WAEGAN: A GANs-Based Data Augmentation Method for GPR Data