Abstract:Recently computer vision has been applied in various fields of engineering successfully ranging from manufacturing to autonomous cars. A key player in this development is the achievements of the latest object detection and classification architectures. In this study, we utilized computer vision and the latest object detection techniques for an automated assessment system. It is developed to reduce the person-hours involved in worker training assessment. In our local building and construction industry, workers are required to be certificated for their technical skills in order to qualify working in this industry. For the qualification, they are required to go through a training and assessment process. During the assessment, trainees implement an assembly such as electrical wiring and wall-trunking by referring to technical drawings provided. Trainees’ work quality and correctness are then examined by a team of experts manually and visually, which is a time-consuming process. The system described in this paper aims to automate the assessment process to reduce the significant person-hours required during the assessment. We employed computer vision techniques to measure the dimensions, orientation, and position of the wall assembly produced hence speeding up the assessment process. A number of key parts and components are analyzed and their discrepancies from the technical drawing are reported as the assessment result. The performance of the developed system depends on the accurate detection of the wall assembly objects and their corner points. Corner points are used as reference points for the measurements, considering the shape of objects, in this particular application. However, conventional corner detection algorithms are founded upon pixel-based operations and they return many redundant or false corner points. In this study, we employed a hybrid approach using deep learning and conventional corner detection algorithms. Deep learning is employed to detect the whereabouts of objects as well as their reference corner points in the image. We then perform a search within these locations for potential corner points returned from the conventional corner detector algorithm. This approach resulted in highly accurate detection of reference points for measurements and evaluation of the assembly.

Autonomous mobile robot for visual inspection of MEP provisions

Evaluation of a Smart Mobile Robotic System for Industrial Plant Inspection and Supervision

Robot-Assisted Object Detection for Construction Automation: Data and Information-Driven Approach

GIS Room Autonomous Inspection System Based on Multi-rotor UAV

Developing Smart MAVs for Autonomous Inspection in GPS-denied Constructions

Design and Simulation of a Mobile Robot for Pipeline Inspection

Robust Autonomous Mobile Manipulation for Substation Inspection

Visually Encoded Contact Inspection System for EMATs

Real-Time and Remote Construction Progress Monitoring with a Quadruped Robot Using Augmented Reality

Construction inspection & monitoring with quadruped robots in future human-robot teaming: A preliminary study

Autonomous Robotic System for Pipeline Integrity Inspection

Toward Fully Automated Inspection of Critical Assets Supported by Autonomous Mobile Robots, Vision Sensors, and Artificial Intelligence

Computer Vision-Based Inspection System for Worker Training in Build and Construction Industry

Safety-critical Autonomous Inspection of Distillation Columns using Quadrupedal Robots Equipped with Roller Arms

Autonomous control for miniaturized mobile robots in unknown pipe networks

MODULAR CLIMBING ROBOT DESIGN WITH AUTOMATED VISION-BASED DEFECT CLASSIFICATION

Machine learning techniques for robotic and autonomous inspection of mechanical systems and civil infrastructure

Localisation and Navigation Framework for Autonomous Railway Robotic Inspection and Repair System

Automated Geometric Quality Inspection of Prefabricated Housing Units Using BIM and LiDAR

Robotic System with Power Line Communication for In-pipe Inspection of Underground Urban Gas Pipeline

Use-Inspired Mobile Robot to Improve Safety of Building Retrofit Workforce in Constrained Spaces