Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

SYNOSIS: Image synthesis pipeline for machine vision in metal surface inspection

Synthetic training data generation for deep learning based quality inspection

Stochastic Geometry Models for Texture Synthesis of Machined Metallic Surfaces: Sandblasting and Milling

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Image Synthesis as a Pretext for Unsupervised Histopathological Diagnosis

Synthetic data generation using finite element method to pre-train an image segmentation model for defect detection using infrared thermography

SYNTA: A novel approach for deep learning-based image analysis in muscle histopathology using photo-realistic synthetic data

Synthetic-to-real Composite Semantic Segmentation in Additive Manufacturing

Automated surface defect detection in metals: a comparative review of object detection and semantic segmentation using deep learning

Controllable Image Synthesis of Industrial Data Using Stable Diffusion

Deep Learning Strategies for Industrial Surface Defect Detection Systems

Visual Car Brand Classification by Implementing a Synthetic Image Dataset Creation Pipeline

Physics Informed Synthetic Image Generation for Deep Learning-Based Detection of Wrinkles and Folds

Evaluating Generalization, Bias, and Fairness in Deep Learning for Metal Surface Defect Detection: A Comparative Study

Segmentation-based deep-learning approach for surface-defect detection

Investigation of the Impact of Synthetic Training Data in the Industrial Application of Terminal Strip Object Detection

IndusSynthe: Synthetic data using human-machine intelligence hybrid for enhanced industrial surface defect detection through self-updating with multi-view filtering

Synthetic Training Data in AI-Driven Quality Inspection: The Significance of Camera, Lighting, and Noise Parameters

Towards Reducing Data Acquisition and Labeling for Defect Detection using Simulated Data

Procedural Modeling and Physically Based Rendering for Synthetic Data Generation in Automotive Applications

SSIS-Seg: Simulation-Supervised Image Synthesis for Surgical Instrument Segmentation