Abstract:Surface defect detection is crucial in maintaining product quality across various industries. Traditional manual inspection methods are often time-consuming and subjective, which can result in inaccuracies and higher production costs. With the use of deep learning techniques, significant advancements have been made in automating the process of surface defect detection in recent years. Moreover, deep learning includes a variety of techniques, and image recognition-based deep learning is especially relevant to our field of study, which is the main focus of this research paper.In the industrial surface defect detection field, researchers have always aimed to create a deep learning-based intelligent defect detection system that achieves near-zero defect rates while maintaining a lightweight, efficient, and cost-effective solution. However, these objectives often conflict with each other, and it is unrealistic to develop a model that can achieve all of them simultaneously. Some trade-offs must be made. If accuracy is the top priority, a large amount of defective data labeled for supervised learning is usually required. If lightweight and low cost is prioritized, a simple small model such as Auto-Encoder is usually used, along with a large number of flawless images for unsupervised learning to minimize the cost of labeling.As mentioned before, it is very difficult to design a single model that can achieve all of them simultaneously. However, present-day studies frequently center on accomplishing those tasks using a single model and rarely address the multi-model architecture. This paper presents a Surface Defect Detection and Classification System that builds on the current state-of-the-art model in the field of surface defect detection, along with the zero-shot learning (ZSL) classifier based on VAEGAN and the Variational Auto-Encoder developed by our laboratory.We have developed a Surface Defect Detection and Classification System that effectively integrates the aforementioned three models. It has been validated on a dataset of metal surface defects, yielding excellent results. This system not only achieves defect detection rates that comply with industrial standards and low false positive rates but also maintains characteristics such as lightweight, low latency, and low annotation cost. In addition to achieving the above goals, this system can also instantly identify and issue anomaly notifications when there are unseen anomalies, which is generally impossible to do with supervised learning anomaly detection models.

A Masked Autoencoder -Based Approach for Defect Classification in Semiconductor Manufacturing

Detection of Defects on Metal Surfaces Based on PoolFormer Auto-Encoder

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Auto-Labeling for Pattern Recognition of Wafer Defect Maps in Semiconductor Manufacturing

A self-supervised learning framework based on masked autoencoder for complex wafer bin map classification

Deep Learning based Defect classification and detection in SEM images: A Mask R-CNN approach

Positive-Sample-Based Surface Defect Detection Using Memory-Augmented Adversarial Autoencoders

Defect intelligent recognition of membrane product based on deep learning

Few-Shot Classification of Screen Defects with Class-Agnostic Mask and Context-Based Classifier.

Defective wafer detection using a denoising autoencoder for semiconductor manufacturing processes

Features Masked Auto-Encoder-Based Anomaly Detection in Process Industry

A Simple Confidence-Supervised Model for High-Resolution Defect Recognition

A Defect-Inspection System Constructed by Applying Autoencoder with Clustered Latent Vectors and Multi-Thresholding Classification

A SelectiveNet-Based Method for Defect Classification in Semiconductor Manufacturing

Two-Stage Metal Surface Defect Detection and Classification System Based on VAEGAN and Class-Embedding

Wafer Map Defect Classification Using Autoencoder-Based Data Augmentation and Convolutional Neural Network

Clear Memory-Augmented Auto-Encoder for Surface Defect Detection

Knowledge augmented broad learning system for computer vision based mixed-type defect detection in semiconductor manufacturing

An Autoencoder-based Approach for Fault Detection in Multi-stage Manufacturing: a Sputter Deposition and Rapid Thermal Processing case study

A CAM-based Weakly Supervised Method for Surface Defect Inspection

Applying Data Augmentation and Mask R-CNN-Based Instance Segmentation Method for Mixed-Type Wafer Maps Defect Patterns Classification