Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Metal Surface Defect Detection Based on a Transformer with Multi-Scale Mask Feature Fusion

Detection of Defects on Metal Surfaces Based on PoolFormer Auto-Encoder

Defect-aware transformer network for intelligent visual surface defect detection

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Steel surface defect detection based on sparse global attention transformer

Weakly Supervised Steel Surface Defect Detection Via Vision Transformer with Background Suppression

Metal surface defect detection based on grouped convolution and bidirectional feature fusion

Automated Detection of Defects on Metal Surfaces using Vision Transformers

Detection Transformer with Multi-Scale Fusion Attention Mechanism for Aero-Engine Turbine Blade Cast Defect Detection Considering Comprehensive Features

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

A deep learning model for steel surface defect detection

An industrial product surface anomaly detection method based on masked image modeling

Vision-Based Surface Defect Detection for Precision Stamping Metal Parts

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

A Multi-level spatial feature fusion-based transformer for intelligent defect recognition with small samples toward smart manufacturing system

ASFormer: Attentive Semantic Feature Fusion Transformer for Pixel -level Defect Detection

Image segmentation using Vision Transformer for tunnel defect assessment

Transformer-based visual inspection algorithm for surface defects

Defect transformer: An efficient hybrid transformer architecture for surface defect detection

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

Investigating Lightweight Transformer Models for Defect Detection