Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Metallographic Image Augmentation of Heat-resistant Steel Based on Improved DCGAN

Classification of Aging Grade of Heat-resistant Steel Based on Improved Shufflenet Network

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Mechanical Properties Prediction for Hot Rolled Alloy Steel Using Convolutional Neural Network.

Data Augmentation of Micrographs and Prediction of Impact Toughness for Cast Austenitic Steel by Machine Learning

Spatiotemporal Prediction and Characterization of Microstructure Evolution During In-Situ Heat Treatment Using a Deep Learning Algorithm

Metallographic image segmentation of GCr15 bearing steel based on CGAN

Image Enhancement of Steel Plate Defects Based on Generative Adversarial Networks

Oxygen Content Control in the Electroslag Remelting Process: An Incremental Learning Strategy Based on Optimized Wasserstein Generative Adversarial Network with Gradient Penalty Data Augmentation

Feature Extraction and Microstructural Classification of Hot Stamping Ultra-High Strength Steel by Machine Learning

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Label Noise Learning Method for Metallographic Image Recognition of Heat-Resistant Steel for Use in Pressure Equipment

Deep Learning-Based Automatic Defect Detection of Additive Manufactured Stainless Steel

Intelligent Classification of Metallographic Based on Improved Deep Residual Efficiency Networks

Study on the Recognition of Metallurgical Graphs Based on Deep Learning

An Improved GANs Model for Steel Plate Defect Detection

Narrow Gap GTAW Defect Detection and Classification Based on Transfer Learning of Generative Adversarial Networks

Image Deep Learning Assisted Prediction of Mechanical and Corrosion Behavior for Al-Zn-Mg Alloys

An End-to-End Steel Surface Classification Approach Based on EDCGAN and MobileNet V2

Automatic detection of carbon steel corrosion degree based on image identification

Quantitative Analysis of Metallographic Image Using Attention-Aware Deep Neural Networks