Abstract:Recently computer vision has been applied in various fields of engineering successfully ranging from manufacturing to autonomous cars. A key player in this development is the achievements of the latest object detection and classification architectures. In this study, we utilized computer vision and the latest object detection techniques for an automated assessment system. It is developed to reduce the person-hours involved in worker training assessment. In our local building and construction industry, workers are required to be certificated for their technical skills in order to qualify working in this industry. For the qualification, they are required to go through a training and assessment process. During the assessment, trainees implement an assembly such as electrical wiring and wall-trunking by referring to technical drawings provided. Trainees’ work quality and correctness are then examined by a team of experts manually and visually, which is a time-consuming process. The system described in this paper aims to automate the assessment process to reduce the significant person-hours required during the assessment. We employed computer vision techniques to measure the dimensions, orientation, and position of the wall assembly produced hence speeding up the assessment process. A number of key parts and components are analyzed and their discrepancies from the technical drawing are reported as the assessment result. The performance of the developed system depends on the accurate detection of the wall assembly objects and their corner points. Corner points are used as reference points for the measurements, considering the shape of objects, in this particular application. However, conventional corner detection algorithms are founded upon pixel-based operations and they return many redundant or false corner points. In this study, we employed a hybrid approach using deep learning and conventional corner detection algorithms. Deep learning is employed to detect the whereabouts of objects as well as their reference corner points in the image. We then perform a search within these locations for potential corner points returned from the conventional corner detector algorithm. This approach resulted in highly accurate detection of reference points for measurements and evaluation of the assembly.

Automatic Screening system for Mechanical parts using Harris Corner Detection algorithm based Artificial Neural Networks

Non-Contact Vision Inspection System Of Geometric Dimension Based On Labview And Imaq Vision

The Application of a Damage Detection Method Using Artificial Neural Network and Train-Induced Vibrations on a Simplified Railway Bridge Model

Revolutionizing the Application of Automatic Inspection System for Industrial Parts Using AI Machine Vision Technology

A Novel Approach To Component Assembly Inspection Based On Mask R-Cnn And Support Vector Machines

Customized Convolutional Neural Networks Technology for Machined Product Inspection

Approaches for Accuracy Improvement of the X-ray Image Defect Detection of Automobile Casting Aluminum Parts Based on Deep Learning

Online Assembly Inspection Integrating Lightweight Hybrid Neural Network With Positioning Box Matching

Artificial Intelligence-Based Smart Quality Inspection for Manufacturing

An Automatic Surface Defect Inspection System for Automobiles Using Machine Vision Methods

Machine vision for 3D mechanical part recognition in intelligent manufacturing environments

Computerized image analysis in manufacturing industry anomaly detection using artificial intelligence techniques

Prediction of surface roughness in CNC end milling by machine vision system using artificial neural network based on 2D Fourier transform

Application of AI intelligent vision detection technology using deep learning algorithm

A Smart Operator Assistance System Using Deep Learning for Angle Measurement

Quality inspection system for metal parts based on machine vision

Automatic System to Measure Mechanical Parts Based on Edge Detection

Computer Vision-Based Inspection System for Worker Training in Build and Construction Industry

Machine Learning Based Mechanical Fault Diagnosis and Detection Methods: A Systematic Review

Enhancing automated defect detection through sequential clustering and classification: An industrial case study using the Sine-Cosine Algorithm, Possibilistic Fuzzy c-means, and Artificial Neural Network

Interactive Visual Inspection of a Rough-Alignment Plastic Part Based on HLAC Features and One-Class SVM