Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

A study on spot welding quality judgment based on improved generative adversarial network and auto-encoder

Denoising and feature extraction of weld seam profiles by stacked denoising autoencoder

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Online Quality Inspection of Ultrasonic Composite Welding by Combining Artificial Intelligence Technologies with Welding Process Signatures

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

Weld Joint Penetration State Sequential Identification Algorithm Based on Representation Learning of Weld Images

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Welding Quality Monitoring of High Frequency Straight Seam Pipe Based on Image Feature

Cyclegan Network for Sheet Metal Welding Drawing Translation

Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

Weld Image Recognition Based on Deep Learning

An end-to-end framework based on acoustic emission for welding penetration prediction

Automatic Detection of Welding Defects Using Deep Neural Network

Performance Enhancement of Ultrasonic Weld Defect Detection Network Based on Generative Data

A weld feature points detection method based on improved YOLO for welding robots in strong noise environment

Deep Network-Assisted Quality Inspection of Laser Welding on Power Battery

Online detection of weld surface defects based on improved incremental learning approach

A High-Quality Sample Generation Method for Improving Steel Surface Defect Inspection

A Quality Diagnosis Method of GMAW Based on Improved Empirical Mode Decomposition and Extreme Learning Machine

Autonomous nondestructive evaluation of resistance spot welded joints

Online quality inspection of resistance spot welding for automotive production lines