Abstract:Automatic defect-detection technology based on deep learning is increasingly used for distinguishing production quality by many industries. However, production lines are usually installed with lots of function modules, which make it difficult to integrate new modules. Common deep learning models run on PC platforms and require a big space with high cost, while ARM64 mobile platforms are much smaller with less cost and equivalent connectivity but also weaker performance. Considering these facts, ARM64 platforms with a fully optimized model are the best solution for adding a defect-detection function for existing production lines. This paper focused on a mobile-optimized model to achieve higher speed and equivalent precision on the ARM64 mobile platform for detection. First, the model structure is simplified by reducing the redundancy of feature maps to increase the network inference speed. Second, a convolutional block attention module is attached to compensate for the decrease in precision caused by structure simplification. Furthermore, a transfer learning method is adopted to improve training performance. Finally, the trained and compiled module is exported to the PyTorch Mobile format and deployed on the mobile platform application to execute its defect-detection function. The results show that the optimized network achieves a speed of 2.124 fps, 210.7% compared with that of You Only Look Once v5n, i.e., 1.008 fps, on the RK3399 ARM64 platform, and has an average mAP of 99.2%. The studied mobile-optimized model has better speed and equivalent precision and can be available on many different ARM64 platforms regardless of the processor manufacturer. It can satisfy the need for real-time defect detection and can be used in similar scenarios. In the future, more improvements could be made such as deploying on platforms with NPU support to achieve faster speed, exploring the relationships between dataset properties and transfer learning effects, even training and running the model directly on ARM64 platforms.

AI on edge device for laser chip defect detection

Small-scale defect detection in industrial environment based on lightweight deep learning network

Industry-Oriented Detection Method of PCBA Defects Using Semantic Segmentation Models

An automatic defect detection method for TO56 semiconductor laser using deep convolutional neural network

Retinomorphic Machine Vision in a Network Laser

Branchy Deep Learning Based Real-Time Defect Detection Under Edge-Cloud Fusion Architecture

A Novel Visual Fault Detection and Classification System for Semiconductor Manufacturing Using Stacked Hybrid Convolutional Neural Networks

Fault Diagnosis in Microelectronics Attachment via Deep Learning Analysis of 3D Laser Scans

A Deep Learning Approach to Classify and Detect Defects in the Components Manufactured by Laser Directed Energy Deposition Process

A Simple Confidence-Supervised Model for High-Resolution Defect Recognition

Fully convolutional networks for chip-wise defect detection employing photoluminescence images

Machine Learning Based Wafer Defect Detection

Inspection and Classification of Semiconductor Wafer Surface Defects Using CNN Deep Learning Networks

PCBNet: A Lightweight Convolutional Neural Network for Defect Inspection in Surface Mount Technology

CPDD-CLMM: a comprehensive lightweight mobile-optimized network for composite plate defect detection

Automated defect inspection of LED chip using deep convolutional neural network

High-Throughput, High-Performance Deep Learning-Driven Light Guide Plate Surface Visual Quality Inspection Tailored for Real-World Manufacturing Environments

Adversarial Defect Detection in Semiconductor Manufacturing Process

Deep Learning based Defect classification and detection in SEM images: A Mask R-CNN approach

Efficient Micro-LED defect detection based on microscopic vision and deep learning

Applying Machine Learning to Construct a Printed Circuit Board Gold Finger Defect Detection System