Abstract:The integrity of product assembly in the precision assembly industry significantly influences the quality of the final products. During the assembly process, products may acquire assembly defects due to personnel oversight. A severe assembly defect could impair the product's normal function and potentially cause loss of life or property for the user. For workpiece defect inspection, there is limited discussion on the simultaneous detection of the primary kinds of assembly anomaly (missing parts, misplaced parts, foreign objects, and extra parts). However, these assembly anomalies account for most customer complaints in the traditional hand tool industry. This is because no equipment can comprehensively inspect major assembly defects, and inspections rely solely on professionals using simple tools and their own experience. Thus, this study proposes an automated visual inspection system to achieve defect inspection in hand tool assembly. This study samples the work-in-process from three assembly stations in the ratchet wrench assembly process; an investigation of 28 common assembly defect types is presented, covering the 4 kinds of assembly anomaly in the assembly operation; also, this study captures sample images of various assembly defects for the experiments. First, the captured images are filtered to eliminate surface reflection noise from the workpiece; then, a circular mask is given at the assembly position to extract the ROI area; next, the filtered ROI images are used to create a defect-type label set using manual annotation; after this, the R-CNN series network models are applied to object feature extraction and classification; finally, they are compared with other object detection models to identify which inspection model has the better performance. The experimental results show that, if each station uses the best model for defect inspection, it can effectively detect and classify defects. The average defect detection rate (1-β) of each station is 92.64%, the average misjudgment rate (α) is 6.68%, and the average correct classification rate (CR) is 88.03%.

A Novel Approach To Component Assembly Inspection Based On Mask R-Cnn And Support Vector Machines

Learning-Based Hand Motion Capture and Understanding in Assembly Process

Online Assembly Inspection Integrating Lightweight Hybrid Neural Network With Positioning Box Matching

A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN

Chassis Assembly Detection and Identification Based on Deep Learning Component Instance Segmentation.

A Digital Twin-Driven Guidance Method for Human-Machine Collaborative Assembly Operations Based on Machine Learning and Computer Vision

Monitoring of Assembly Process Using Deep Learning Technology.

A Smart Surface Inspection System Using Faster R-CNN in Cloud-Edge Computing Environment

Part Automatic Assembling System Based on Machine Vision

Deep learning-based augmented reality work instruction assistance system for complex manual assembly

Integrating Knowledge and Augmented Reality: A Novel Framework for Intelligent Assembly Assistance

Assembly Integrity Detection Based on 3D CAD Model

Utilizing Deep Learning for Defect Inspection in Hand Tool Assembly

Research on intelligent auxiliary assembly technology based on deep learning

Industrial Robot Components Assembly Based on Machine Vision Technology

Manufacturability Driven Interacting Machining Feature Recognition Algorithms for 3D CAD Models

Various realization methods of machine-part classification based on deep learning

An OVR-SVM Based Machine Vision Evaluation Method for Standard Component Assembly

Manufacture Assembly Fault Detection Method Based on Deep Learning and Mixed Reality

A computer vision-based assistant system for the assembly of narrow cabin products

A digital twin-driven human-machine interactive assembly method based on lightweight multi-target detection and assembly feature generation