Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

A Generative Adversarial Networks (GAN) based efficient sampling method for inverse design of metallic glasses

Generative adversarial networks (GAN) based efficient sampling of chemical space for inverse design of inorganic materials

Generative adversarial networks (GAN) based efficient sampling of chemical composition space for inverse design of inorganic materials

Inverse design machine learning model for metallic glasses with good glass-forming ability and properties

A generative deep learning framework for inverse design of compositionally complex bulk metallic glasses

NSGAN: a non-dominant sorting optimisation-based generative adversarial design framework for alloy discovery

Evolutionary design of machine-learning-predicted bulk metallic glasses

Denoising diffusion probabilistic models for generative alloy design

Machine Learning Aided Prediction of Glass-Forming Ability of Metallic Glass

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Highly effective design of high GFA alloys with different metal-based and various components by machine learning

Revolutionising inverse design of magnesium alloys through generative adversarial networks

Machine-learning improves understanding of glass formation in metallic systems

Data-driven discovery of a universal indicator for metallic glass forming ability

A two-step fused machine learning approach for the prediction of glass-forming ability of metallic glasses

Efficient Learning Strategy for Predicting Glass Forming Ability in Imbalanced Datasets of Bulk Metallic Glasses

High-Throughput Synthesis and Characterization Screening of Mg-Cu-Y Metallic Glass

Data-driven prediction of the glass-forming ability of modeled alloys by supervised machine learning

Predicting multi-component, high-temperature metallic glasses by coupling empirical models, CALPHAD, and a genetic algorithm