Object Detection Using ESP32 Cameras for Quality Control of Steel Components in Manufacturing Structures

Shakor, Pshtiwan
DOI: https://doi.org/10.1007/s13369-022-07562-2
IF: 2.807
2022-12-24
Arabian Journal for Science and Engineering
Abstract:Automation in the construction industry has become more appealing in recent years. Although the industry fosters material mixing and structural application, automating quality control is not investigated broadly. The industry relies on manual inspection, leading to inaccuracy and lower productivity. This research focuses on the quality check of bolted steel members using automating ESP32 camera to detect missing bolts. Earlier studies focused on improving the quality of tightening the bolts. However, the major problem of missing bolts has not been extensively addressed. Inadequate bolting of steel members causes a considerable reduction in mechanical strength, and it may cause a structure to fail. Hence, this paper aims to detect missing bolts in assembling steel structures. The study was conducted by developing a system that utilizes an ESP32 camera module to capture the steel members in real-time. Captured video is processed in Visual Studio (C++ language), another approach carried out in the study is using a faster region-based convolutional neural network (Faster R-CNN) where it extracts the area of interest, the bolts, and holes in the steel members with the assistance of an image dataset and training. The trained model can be used to detect bolts and holes. The results showed that the developed system is reliable and can alter the user to any missing bolts, having TensorFlow object detection with the Faster R-CNN algorithm successfully provided desired results with 95% precision. This technique increases the efficiency of quality monitoring. Consequently, the steel manufacturing industry can rely on smart cameras to monitor the quality control of steel frames, leading to productive output. This also saves the workers time from performing the tedious task of inspecting every steel member and assists in maintaining the quality of the assembled steel structures.
multidisciplinary sciences
What problem does this paper attempt to address?