Abstract:Recently computer vision has been applied in various fields of engineering successfully ranging from manufacturing to autonomous cars. A key player in this development is the achievements of the latest object detection and classification architectures. In this study, we utilized computer vision and the latest object detection techniques for an automated assessment system. It is developed to reduce the person-hours involved in worker training assessment. In our local building and construction industry, workers are required to be certificated for their technical skills in order to qualify working in this industry. For the qualification, they are required to go through a training and assessment process. During the assessment, trainees implement an assembly such as electrical wiring and wall-trunking by referring to technical drawings provided. Trainees’ work quality and correctness are then examined by a team of experts manually and visually, which is a time-consuming process. The system described in this paper aims to automate the assessment process to reduce the significant person-hours required during the assessment. We employed computer vision techniques to measure the dimensions, orientation, and position of the wall assembly produced hence speeding up the assessment process. A number of key parts and components are analyzed and their discrepancies from the technical drawing are reported as the assessment result. The performance of the developed system depends on the accurate detection of the wall assembly objects and their corner points. Corner points are used as reference points for the measurements, considering the shape of objects, in this particular application. However, conventional corner detection algorithms are founded upon pixel-based operations and they return many redundant or false corner points. In this study, we employed a hybrid approach using deep learning and conventional corner detection algorithms. Deep learning is employed to detect the whereabouts of objects as well as their reference corner points in the image. We then perform a search within these locations for potential corner points returned from the conventional corner detector algorithm. This approach resulted in highly accurate detection of reference points for measurements and evaluation of the assembly.

Computer Vision Implementation in Scratch Inspection and Color Detection on The Car Roof Surface

Scratch Detection Technology for Product Surface Based on Improved Contourlet Transform

An Automatic Surface Defect Inspection System for Automobiles Using Machine Vision Methods

An Effective MID-based Visual Defect Detection Method for Specular Car Body Surface

Deep Learning Models for Visual Inspection on Automotive Assembling Line

Approach to Automated Visual Inspection of Objects Based on Artificial Intelligence

A Mobile Vision Inspection System for Tiny Defect Detection on Smooth Car-Body Surfaces Based on Deep Ensemble Learning

Computer Vision-Based Inspection System for Worker Training in Build and Construction Industry

A Lightweight Appearance Quality Assessment System Based on Parallel Deep Learning for Painted Car Body

Automatic Detection and Classification of Defective Areas on Metal Parts by Using Adaptive Fusion of Faster R-CNN and Shape From Shading

Automated Measurement of Smartphone Screen Scratches Using Visual Methods

Machine Vision based quality inspection for automotive parts using edge detection technique

Semi-supervised method for visual detection of automotive paint defects

Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application

Research on detection and classification of automotive body surface defects based on image processing and machine learning

Deep Learning Application in Detecting Glass Defects with Color Space Conversion and Adaptive Histogram Equalization

Visual Inspection of the Aircraft Surface Using a Teleoperated Reconfigurable Climbing Robot and Enhanced Deep Learning Technique

Automated Metal Surface Flaws Detection Using Convolutional Neural Network and Deep Visualization Analysis

Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques

Vehicle Detection and Identification Using Computer Vision Technology with the Utilization of the YOLOv8 Deep Learning Method

Computer Vision-based Robotic Arm for Object Color, Shape, and Size Detection