Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

IRT-GAN: A Generative Adversarial Network with a Multi-Headed Fusion Strategy for Automated Defect Detection in Composites Using Infrared Thermography

IRT-GAN: A GAN Framework for Automated Defect Segmentation in Composites Using Infrared Thermography

Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

Generative Independent Component Thermography for Improved Defect Detection of Carbon Fiber Composites

A Flexible Deep Learning Framework for Thermographic Inspection of Composites

Enhanced Defect Detection in Carbon Fiber Reinforced Polymer Composites via Generative Kernel Principal Component Thermography

DeftectNet: Joint Loss Structured Deep Adversarial Network for Thermography Defect Detecting System

Generative Manifold Learning Thermography for Non-Destructive Evaluation of Defects in Composite Materials

Deep Adversarial Network for CFRP Thermal Imaging Debond Diagnosis

Data-Augmented Manifold Learning Thermography for Defect Detection and Evaluation of Polymer Composites

One-dimensional deep convolutional autoencoder active infrared thermography: Enhanced visualization of internal defects in FRP composites

Deep Autoencoder for Non-destructive Testing of Defects in Polymer Composites

Detecting Internal Defects in FRP-Reinforced Concrete Structures through the Integration of Infrared Thermography and Deep Learning

Intelligent Detection Algorithm Based on 2D/3D-UNet for Internal Defects of Carbon Fiber Composites

A Cyclic Self-Enhancement Technique for Complex Defect Profile Reconstruction Based on Thermographic Evaluation

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Multistage GAN for Fabric Defect Detection

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspection

Synthetic X-ray Image Generation for Non-Destructive Testing using Generative Adversarial Networks

Automatic Defect Classification for Infrared Thermography in CFRP based on Deep Learning Dense Convolutional Neural Network