Abstract:In the manufacturing industry, automatic quality inspections can lead to improved product quality and productivity. Deep learning-based computer vision technologies, with their superior performance in many applications, can be a possible solution for automatic quality inspections. However, collecting a large amount of annotated training data for deep learning is expensive and time-consuming, especially for processes involving various products and human activities such as assembly. To address this challenge, we propose a method for automated assembly quality inspection using synthetic data generated from computer-aided design (CAD) models. The method involves two steps: automatic data generation and model implementation. In the first step, we generate synthetic data in two formats: two-dimensional (2D) images and three-dimensional (3D) point clouds. In the second step, we apply different state-of-the-art deep learning approaches to the data for quality inspection, including unsupervised domain adaptation, i.e., a method of adapting models across different data distributions, and transfer learning, which transfers knowledge between related tasks. We evaluate the methods in a case study of pedal car front-wheel assembly quality inspection to identify the possible optimal approach for assembly quality inspection. Our results show that the method using Transfer Learning on 2D synthetic images achieves superior performance compared with others. Specifically, it attained 95% accuracy through fine-tuning with only five annotated real images per class. With promising results, our method may be suggested for other similar quality inspection use cases. By utilizing synthetic CAD data, our method reduces the need for manual data collection and annotation. Furthermore, our method performs well on test data with different backgrounds, making it suitable for different manufacturing environments.

Domain adaptive segmentation method for mechanical assembly based on iterative loops

A Domain-Adaptive Segmentation Method Based on Segment Anything Model for Mechanical Assembly

Semantic segmentation of mechanical assembly using selective kernel convolution UNet with fully connected conditional random field

Assembly Monitoring Using Semantic Segmentation Network Based on Multiscale Feature Maps and Trainable Guided Filter

Unsupervised Domain Adaptation Approach for Vision-Based Semantic Understanding of Bridge Inspection Scenes Without Manual Annotations

Self-ensembling with mask-boundary domain adaptation for optic disc and cup segmentation

Monitoring of Assembly Process Using Deep Learning Technology.

SS-ADA: A Semi-Supervised Active Domain Adaptation Framework for Semantic Segmentation

IterDANet: Iterative Intra-Domain Adaptation for Semantic Segmentation of Remote Sensing Images

DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation

3D Modelling of a Frame Assembly Using Deep Learning and the Chu–Liu–Edmonds Algorithm

Research on intelligent auxiliary assembly technology based on deep learning

Iterative Loop Method Combining Active and Semi-Supervised Learning for Domain Adaptive Semantic Segmentation

Unsupervised domain adaptive segmentation algorithm based on two-level category alignment

Deep Learning-Based Generic Automatic Surface Defect Inspection (ASDI) with Pixelwise Segmentation

Automated assembly quality inspection by deep learning with 2D and 3D synthetic CAD data

Learning Part Segmentation Through Unsupervised Domain Adaptation from Synthetic Vehicles

Multi-level joint distributed alignment-based domain adaptation for cross-scenario strip defect recognition

IDPL: Intra-subdomain adaptation adversarial learning segmentation method based on Dynamic Pseudo Labels

Domain Adaptative Semantic Segmentation by Fine-Grained Alignment

Domain-Agnostic Learning with Anatomy-Consistent Embedding for Cross-Modality Liver Segmentation