Abstract:Industry 4.0 has been a hot topic in recent years. The process of integrating Cyber-Physical Systems (CPS), Artificial Intelligence (AI), and Internet of Things (IoT) technology, will become the trend in future construction of smart factories. In the past, smart factories were developed around the concept of the Flexible Manufacturing System (FMS). Most parts of the quality management process still needed to be implemented by Automated Optical Inspection (AOI) methods which required human resources and time to perform second stage testing. Screening standards also resulted in the elimination of about 30% of the products. In this study, we sort and analyze several Region-based Convolutional Neural Network (R-CNN) and YOLO models that are currently more advanced and widely used, analyze the methods and development problems of the various models, and propose a suitable real-time image recognition model and architecture suitable for Integrated Circuit Board (ICB) in manufacturing process. The goal of the first stage of this study is to collect and use different types of ICBs as model training data sets, and establish a preliminary image recognition model that can classify and predict different types of ICBs based on different feature points. The second stage explores image augmentation fusion and optimization methods. The data augmentation method used in this study can reach an average accuracy of 96.53%. In the final stage, there is discussion of the applicability of the model to detect and recognize the ICB directionality in <1 s with a 98% accuracy rate to meet the real-time requirements of smart manufacturing. Accurate and instant object image recognition in the smart manufacturing process can save manpower required for testing, improve equipment effectiveness, and increase both the production capacity and the yield rate of the production line. The proposed model improves the overall manufacturing process.

ICML: Machine Learning-based Transistor-level Integrated Circuit Layout Error Classification using Color Analysis and Segmentation

Accelerating Chip Design with Machine Learning: from Pre-Silicon to Post-Silicon

From IC Layout to Die Photo: A CNN-Based Data-Driven Approach

Automatic Error Detection in Integrated Circuits Image Segmentation: A Data-driven Approach.

Domain-Integrated Machine Learning for IC Image Analysis

MLConnect: A Machine Learning Based Connection Prediction Framework for Error Correction in Recovered Circuit

A Hierarchical Multiclassifier System for Automated Analysis of Delayered IC Images

Delayered IC Image Analysis with Template-Based Tanimoto Convolution and Morphological Decision.

LithoHoD: A Litho Simulator-Powered Framework for IC Layout Hotspot Detection

Logo Classification and Data Augmentation Techniques for PCB Assurance and Counterfeit Detection

Applying Machine Learning to Construct a Printed Circuit Board Gold Finger Defect Detection System

Automatic Layout Generation with Applications in Machine Learning Engine Evaluation

Lithography Hotspot Detection Method Based on Transfer Learning Using Pre-Trained Deep Convolutional Neural Network

Patch-Based Adversarial Training for Error-Aware Circuit Annotation of Delayered IC Images

Fault Detection In PCB Using Machine Learning

Modified Deep Learning Approach for Layout Hotspot Detection

Integrated Circuit Mask-Generative Adversarial Network for Circuit Annotation with Targeted Data Augmentation

Implementation of Machine Learning in VLSI Integrated Circuit Design

Color Biological Features-Based Solder Paste Defects Detection and Classification on Printed Circuit Boards

Context-Aware DFM Rule Analysis and Scoring Using Machine Learning

Integrated Circuit Board Object Detection and Image Augmentation Fusion Model Based on YOLO