Abstract:Recently computer vision has been applied in various fields of engineering successfully ranging from manufacturing to autonomous cars. A key player in this development is the achievements of the latest object detection and classification architectures. In this study, we utilized computer vision and the latest object detection techniques for an automated assessment system. It is developed to reduce the person-hours involved in worker training assessment. In our local building and construction industry, workers are required to be certificated for their technical skills in order to qualify working in this industry. For the qualification, they are required to go through a training and assessment process. During the assessment, trainees implement an assembly such as electrical wiring and wall-trunking by referring to technical drawings provided. Trainees’ work quality and correctness are then examined by a team of experts manually and visually, which is a time-consuming process. The system described in this paper aims to automate the assessment process to reduce the significant person-hours required during the assessment. We employed computer vision techniques to measure the dimensions, orientation, and position of the wall assembly produced hence speeding up the assessment process. A number of key parts and components are analyzed and their discrepancies from the technical drawing are reported as the assessment result. The performance of the developed system depends on the accurate detection of the wall assembly objects and their corner points. Corner points are used as reference points for the measurements, considering the shape of objects, in this particular application. However, conventional corner detection algorithms are founded upon pixel-based operations and they return many redundant or false corner points. In this study, we employed a hybrid approach using deep learning and conventional corner detection algorithms. Deep learning is employed to detect the whereabouts of objects as well as their reference corner points in the image. We then perform a search within these locations for potential corner points returned from the conventional corner detector algorithm. This approach resulted in highly accurate detection of reference points for measurements and evaluation of the assembly.

Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning

A Flexible Method for 3D Reconstruction of Urban Building

A Three-Step Computer Vision-Based Framework for Concrete Crack Detection and Dimensions Identification

Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic‐rich building information model

Transfer learning on convolutional activation feature as applied to a building quality assessment robot

Building defect inspection and data management using computer vision, augmented reality, and BIM technology

Towards Automatic Generation of As-Built BIM: 3D Building Facade Modeling and Material Recognition from Images

3D Reconstruction and Attribute Extraction of Building Superficial Defects Based on Point-cloud

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

High-Fidelity Visual Structural Inspections through Transformers and Learnable Resizers

Computer Vision-Based Inspection System for Worker Training in Build and Construction Industry

Semi-automated visualization method for visual inspection of buildings on BIM using 3D point cloud

3D Building Façade Reconstruction Using Deep Learning

Deep Learning for Detecting Building Defects Using Convolutional Neural Networks

Application of Deep Learning and Unmanned Aerial Vehicle on Building Maintenance

3D Reconstruction of Indoor Scenes Via Image Registration

Building Change Detection Based on 3D Reconstruction.

Automatic joint damage quantification using computer vision and deep learning

Robot-assisted mobile scanning for automated 3D reconstruction and point cloud semantic segmentation of building interiors

Surface Damage Detection and Localization for Bridge Visual Inspection Based on Deep Learning and 3D Reconstruction

Defect digital twinning: A technical framework to integrate robotics, AI and BIM for facility management and renovation