Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

A Layer-Wise Surface Deformation Defect Detection by Convolutional Neural Networks in Laser Powder-Bed Fusion Images

Thermal Field Prediction for Welding Paths in Multi-Layer Gas Metal Arc Welding-Based Additive Manufacturing: A Machine Learning Approach

Complicated Deformation Simulating on Temperature-Driven 4D Printed Bilayer Structures Based on Reduced Bilayer Plate Model

Predictive compensation-enabled horizontal inkjet printing of alginate tubular constructs

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

Generative Adversarial Networks for geometric surfaces prediction in injection molding

A CNN-Based Adaptive Surface Monitoring System for Fused Deposition Modeling

Deformation analysis of 3d printed metacarpophalangeal and interphalangeal joints via transfer learning

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Generative Deep Learning-Based Thermographic Inspection of Artwork

Multi-Axis 3D Printing Defect Detecting by Machine Vision with Convolutional Neural Networks

Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection

Automated Real‐Time Detection and Prediction of Interlayer Imperfections in Additive Manufacturing Processes Using Artificial Intelligence

Conditional generative adversarial network for welding deformation field prediction of butt-welded plates

Generative Manifold Learning Thermography for Non-Destructive Evaluation of Defects in Composite Materials

Quick Prediction of Complex Temperature Fields Using Conditional Generative Adversarial Networks

Improving precision of material extrusion 3D printing by in-situ monitoring & predicting 3D geometric deviation using conditional adversarial networks

Enhanced detection of surface deformations in LPBF using deep convolutional neural networks and transfer learning from a porosity model

Multistage GAN for Fabric Defect Detection

3D object quality prediction for Metal Jet Printer with Multimodal thermal encoder