Abstract:Automated surface inspection (ASI) is an important research content in computer vision. In recent years, with the application of deep learning models represented by convolutional neural networks (CNN) in computer vision, surface defect detection based on computer vision has made impressive progress. However, compared with a few or dozens of pictures in real industrial scenes, traditional deep learning methods require a large amount of annotation data for training, so it is quite difficult to adapt to the complex industrial scenarios with varying surface profiles, lighting conditions, imaging angles and environments. Despite these difficulties, there is still a wide gap in the performance between the detection of small-scale and large-scale objects. Traditional Generative Adversarial Nets (GANs) based augmentation method can only be used for classification networks or unsupervised learning, and if applied to detection networks, they need to be labeled, which requires much labor and time. In order to solve these problems, a metal surface small-scale defect images augmentation method is proposed. Our method contains two parts: generation part and augmentation part. In the generation part, two pairs of generators and discriminators are used to generate the defect areas and the background areas of the image, which can not only generate more realistic defect images than others but also save the training process for surface images. In the augmentation part, the real defect images and the generated defect images are concatenated before copy-pasting them on background images to generate annotated dataset for training. We conduct experiments on our metal surface dataset. The experimental results show that our method can generate high-quality defect samples and background samples, which greatly enriches the original dataset. We evaluate different augmentation strategies, and ultimately, we achieve 6.2% improvement on baseline and 4.4% on copy-pasting method.

Generative Adversarial Network for Integrated Circuits Physical Assurance Using Scanning Electron Microscopy

Integrated Circuit Mask-Generative Adversarial Network for Circuit Annotation with Targeted Data Augmentation

Utilizing Generative Adversarial Networks for Image Data Augmentation and Classification of Semiconductor Wafer Dicing Induced Defects

Improving Recognition of Defective Epoxy Images in Integrated Circuit Manufacturing by Data Augmentation

Addressing Class Imbalance and Data Limitations in Advanced Node Semiconductor Defect Inspection: A Generative Approach for SEM Images

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

GRACER: Graph-Based Standard Cell Recognition in IC Images for Hardware Assurance

Deep Learning-Based Image Analysis Framework for Hardware Assurance of Digital Integrated Circuits

EVHA: Explainable Vision System for Hardware Testing and Assurance -- An Overview

EMSim+: Accelerating Electromagnetic Security Evaluation With Generative Adversarial Network and Transfer Learning

Fault diagnosis in semiconductor manufacturing processes using a CNN-based generative adversarial network1

Enhancing scanning electron microscopy imaging quality of weakly conductive samples through unsupervised learning

Leveraging generative adversarial networks to create realistic scanning transmission electron microscopy images

Adversarial Defect Detection in Semiconductor Manufacturing Process

SEM2GDS: A Deep-Learning Based Framework to Detect Malicious Modifications in IC Layout

Semantic-Masked Intensity Augmentation for Deep Learning-based Analysis of FPGA Images

Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis

Rapid mapping of digital integrated circuit logic gates via multi-spectral backside imaging

Parameters, Properties, and Process: Conditional Neural Generation of Realistic SEM Imagery Towards ML-assisted Advanced Manufacturing

Generation of highly realistic microstructural images of alloys from limited data with a style-based generative adversarial network

EM-GAN: Fast Stress Analysis for Multi-Segment Interconnect Using Generative Adversarial Networks