Abstract:Industry 4.0 has been a hot topic in recent years. The process of integrating Cyber-Physical Systems (CPS), Artificial Intelligence (AI), and Internet of Things (IoT) technology, will become the trend in future construction of smart factories. In the past, smart factories were developed around the concept of the Flexible Manufacturing System (FMS). Most parts of the quality management process still needed to be implemented by Automated Optical Inspection (AOI) methods which required human resources and time to perform second stage testing. Screening standards also resulted in the elimination of about 30% of the products. In this study, we sort and analyze several Region-based Convolutional Neural Network (R-CNN) and YOLO models that are currently more advanced and widely used, analyze the methods and development problems of the various models, and propose a suitable real-time image recognition model and architecture suitable for Integrated Circuit Board (ICB) in manufacturing process. The goal of the first stage of this study is to collect and use different types of ICBs as model training data sets, and establish a preliminary image recognition model that can classify and predict different types of ICBs based on different feature points. The second stage explores image augmentation fusion and optimization methods. The data augmentation method used in this study can reach an average accuracy of 96.53%. In the final stage, there is discussion of the applicability of the model to detect and recognize the ICB directionality in <1 s with a 98% accuracy rate to meet the real-time requirements of smart manufacturing. Accurate and instant object image recognition in the smart manufacturing process can save manpower required for testing, improve equipment effectiveness, and increase both the production capacity and the yield rate of the production line. The proposed model improves the overall manufacturing process.

Semantic-Masked Intensity Augmentation for Deep Learning-based Analysis of FPGA Images

FPGA Oriented Lightweight Deep Learning Inference for Liver Cancer Segmentation

Integrated Circuit Mask-Generative Adversarial Network for Circuit Annotation with Targeted Data Augmentation

Deep Learning-Based Image Analysis Framework for Hardware Assurance of Digital Integrated Circuits

An SSD-MobileNet Acceleration Strategy for FPGAs Based on Network Compression and Subgraph Fusion

Generative Adversarial Network for Integrated Circuits Physical Assurance Using Scanning Electron Microscopy

Semantic Image Attack for Visual Model Diagnosis

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Towards Improved Semiconductor Defect Inspection for high-NA EUVL based on SEMI-SuperYOLO-NAS

Deep Learning for Automatic IC Image Analysis.

Domain-Integrated Machine Learning for IC Image Analysis

Delayered IC Image Analysis with Template-Based Tanimoto Convolution and Morphological Decision.

An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design

Integrated Circuit Board Object Detection and Image Augmentation Fusion Model Based on YOLO

Improving Recognition of Defective Epoxy Images in Integrated Circuit Manufacturing by Data Augmentation

Improved Defect Detection and Classification Method for Advanced IC Nodes by Using Slicing Aided Hyper Inference with Refinement Strategy

FenceMask: A Data Augmentation Approach for Pre-extracted Image Features

Deep Learning-Based Integrated Circuit Surface Defect Detection: Addressing Information Density Imbalance for Industrial Application

A Deep Learning-Based FPGA Function Block Detection Method With Bitstream to Image Transformation

Synthetic Data for Semantic Segmentation: A Path to Reverse Engineering in Printed Circuit Boards

SEM2GDS: A Deep-Learning Based Framework to Detect Malicious Modifications in IC Layout